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The  public  expects  military  efficiency  from  the 
combat  forces  it  supports  with  tax  dollars.  The  United 
States  Air  Force  needs  integrative  measures  of  efficiency 
and  needs  decision  support  systems  which  aid  in  detecting 
inefficiencies,  diagnosing  problems,  and  choosing  among 
alternative  courses  of  action  to  improve  the  efficiency 
and  effectiveness  of  combat  units.  The  Data  Envelopment 
Analysis  (DEA)  technique  developed  by  Charnes,  Cooper 
and  Rhodes  provided  the  basic  theoretical  starting  point 
for  this  dissertation.  It  enables  the  unified  analysis 
of  multiple  technical,  economic  and  effectiveness  measures 
in  contrast  to  past  reliance  by  Air  Force  Management  on 
"partial”  measures  of  productivity,  cost  effectiveness, 
etc. 

'Theory  was  extended  by  this  study  to  provide 
analytical  capabilities  suitable  for  use  by  the  Air  Force 
in  the  analysis  and  interpretation  of  efficiency  and  in 


the  preparation  of  management  plans.  These  extensions 
include  methods  for  post  DEA  analysis  to  detect  rates  of 
substitution  and  marginal  productivities  in  nearby  fron¬ 
tier  facets,  facets  which  if  possible  are  formed  solely 
from  empirically  observed  values.  Such  methods  are  needed 
in  developing  resource  allocation  models  and  in  establish¬ 
ing  realistic  output  expectations  in  management  plans. 

Two  important  managerial  questions  related  to  this  re¬ 
search  are:  (l)  how  should  resources  be  allocated  or 

technologies  be  changed  to  improve  the  collective  effi¬ 
ciency  and  effectiveness  of  units?  and  ( 2 )  how  can  the 
performance  of  efficient  units  be  used  to  predict  the 
expected  output  levels  associated  with  various  input 
combinations  ? 

The  final  step  was  to  evaluate  the  suitability 
of  DEA  and  the  aforementioned  extensions  in  measuring  and 
evaluating  the  comparative  efficiency  of  a  hypothetical 
set  of  Air  Force  units  using  realistic,  insightful  data. 
This  included  selecting  relevant  measures  of  input  and 
output  and  then  performing  a  trial  analysis. 

s,  This  dissertation  provided  a  basic  theoretical 
framework  for  future  development  of  decision  support 
prototypes  suitable  for  use  by  the  Air  Force  in  managing 
military  effectiveness  and  efficiency. 
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CHAPTER  I 

THE  PROBLEMS  OF  EVALUATING  AND  MANAGING  THE  CAPABILITY 
AND  EFFICIENCY  OF  AIR  FORCE  UNITS 

Waste  and  inefficiency  never  fed  a  hungry  chili, 
provided  a  job  for  a  willing  worker,  or  educated 
a  deserving  student. 

-  Former  President  Carter  [ 1 2 ] 

Introduct ion 

A.  Charnes,  W.  W.  Cooper,  A.  Bessent,  and  W.  Bes 
sent  (all  of  The  University  of  Texas  at  Austin),  together 
with  E.  Rhodes  (State  University  of  New  York)  have  devel¬ 
oped  and  tested  a  new  method  called  DEA  (Data  Envelopment 
Analysis)  for  measuring  and  evaluating  the  efficiency  of 
not-for-profit  enterprises  in  a  variety  of  contexts  [6, 

18,  19].  The  latter  include  applications  to  both  military 
and  civilian  problems  which  have  all  involved  multiple- 
output  as  well  as  multiple-input  situations  for  each  of  a 
variety  of  managerial  Decision  Making  Uni t s- - he r ea f t er 
called  DMU's--where  a  measure  of  efficiency  was  desired 
which  would  not  require  a  priori  weights  or  similar  de¬ 
vices  to  arrive  at  a  single  overall  (scalar)  measure  of 
efficiency  for  each  such  DMU.  Furthermore,  the  models 


from  which  this  measure  is  derived  also  provide  details  on 


the  sources  and  relative  magnitudes  of  any  inefficiencies 
along  with  information  on  trade  offs  and  other  information 
needed  for  improved  decision  making. 

DEA ,  with  a  few  modifications,  appears  to  have 
significant  potential  for  near  term  use  by  the  military  in 
assessing  and  managing  the  many  facets  of  efficiency  and 
capability.  It  enables  the  unified  analysis  of  multiple 
technical,  economic  and  effectiveness  measures  in  contrast 
to  past  management  and  analysis  techniques  which  relied 
too  heavily  on  "partial"  measures  of  productivity,  cost 
effectiveness,  maintainability,  etc. 

Air  Force  commanders  and  resource  managers  need 
a  tool  for  monitoring  the  efficiency  of  combat  units, 
which  simultaneously  takes  into  account  many  of  the  factors 
including  mix  and  other  variations  that  might  affect  com¬ 
bat  potential.  The  measure  to  be  used  for  these  purposes 
should  be  theoretically  and  logically  justified  in  its 
ability  to  evaluate  the  actual  achievement  of  each  unit 
relative  to  the  maximum  achieved  by  other  comparable  units. 
The  measure  should  be  fair  and  take  into  account  control¬ 
lable  and  uncontrollable  variables.  It  should,  on  the  one 
hand,  provide  a  convenient  summary  in  the  form  of  a  single 
measure  of  efficiency  and,  on  the  other  hand,  make  it 


possible  to  detect  inefficiencies  and  direct  attention  to 


the  relevant  factors  for  correcting  these  inefficiencies. 
It  should  further  reveal  possible  trade  offs  between  dif¬ 
ferent  inputs  and  outputs,  even  when  a  wing  is  operated 
efficiently,  and  should  indicate  opportunities  for  improve 
ment . 


Motivating  Interests  of  the  Air  Force 

Senior  officials  in  the  Department  of  Defense 
and  the  military  services  are  stressing  the  importance  of 
developing  better  ways  of  assessing  military  capability 
and  efficiency  [4l].  There  are  four  basic  questions  which 
motivate  this  inquiry:  (l)  what  level  of  military  capa¬ 

bility  can  the  services  achieve  with  resources  available; 
(2)  what  capability  is  required  and  where  are  the  short¬ 
falls;  (3)  what  resource  acquisitions  or  redistributions 
are  needed  to  gain  maximum  improvement  in  efficiency  and 
effectiveness;  and  (4)  how  can  management  systems  be 
changed  to  improve  the  identification  and  correction  of 
factors  which  limit  the  readiness  of  our  military? 

Several  initiatives  have  been  undertaken  during 
the  past  few  years  to  improve  the  way  the  Department  of 
Defense  measures  readiness  and  capability  [25,  29,  39,  4 1 ] 


One  basic  problem  has  been  the  inability  of  the  military 
to  quantify  and  to  establish  proven  relationships  among 
the  various  logistics  factors  which  affect  performance. 

i 

There  also  exist  important  problems  in  defining  the  mean¬ 
ings  and  interrelationships  among  terms  such  as  readiness, 
capability,  effectiveness  and  efficiency. 

For  purposes  of  this  discussion,  capability  can 
be  defined  as  the  maximum  combat  activity  that  one  can 
reasonably  expect  to  be  produced  by  military  units  operat¬ 
ing  in  a  particular  combat  scenario  given  the  available 
technology,  the  current  levels  of  resources  and  the  mana¬ 
gerial  abilities  of  commanders  and  supervisors.  Effec¬ 
tiveness,  on  the  other  hand,  relates  to  the  degree  of 
achievement  of  established  capability  or  readiness  goals 
for  either  peacetime  preparedness  operations  or  wartime 
combat  operations. 

In  1976,  General  David  C.  Jones,  the  Chairman  of 
the  Joint  Chiefs  of  Staff,  provided  the  following  defini¬ 
tion  of  readiness  [33]: 


Total  force  readiness  is  difficult  to  define:  From 
my  viewpoint,  our  state  of  readiness  certainly  de¬ 
termines  how  rapidly  and  with  what  effect  peacetime 
forces  can  be  brought  to  bear  upon  various  crises  or 
conflict  situations.  It  also  includes  how  long  and 
to  what  degree  our  forces  can  be  employed.  It  em¬ 
bodies  the  capability  to  successfully  accomplish 


tasks  within  a  specified  time  with  current  resources 
and  management  systems.  ...  If  there  are  shortfalls 
due  to  limited  resources  or  poor  management  prac¬ 
tices,  they  should  be  identified  and  corrected.  This 
includes  a  close  examination  of  our  plans  and  readi¬ 
ness  reporting  systems. 

From  the  key  points  in  General  Jones'  definition, 
one  might  distill  the  following  objectives  for  measuring 
and  reporting  an  Air  Force  unit's  combat  readiness  and 
capability.  Based  on  an  evaluation  of  a  unit's  current 
resources  (personnel,  training,  material,  and  weapon  sys¬ 
tems)  and  management  systems,  the  Air  Force  must  be  able 
to  accurately  predict  and  report  a  combat  unit's  capability 
to  deploy  combat  ready  forces  in  the  time  frames  specified 
by  operation  plans  and  to  efficiently  perform  a  variety 
of  wartime  tasks  (combat  sorties,  airlift,  etc.);  and, 
if  unit  capability  is  inadequate,  to  identify  limitations 
or  shortfalls  so  corrections  can  be  made  through  appropri¬ 
ate  management  actions  or  budget  programs. 

Figure  1.1  provides  the  author's  view  of  a  capa¬ 
bility  assessment  and  reporting  system  in  a  planning,  pro¬ 
gramming  and  budgeting  context.  The  system  is  clearly 
complex  and  involves  much  more  than  simply  the  inability 
of  the  Air  Force  to  quantify  and  to  establish  proven  re¬ 
lationships  among  the  various  factors  which  affect 


capability.  What  factors  are  involved,  what  data  is  re¬ 
quired,  who  needs  the  data  and  why  it's  needed,  are  all 
important  questions. 

Of  special  importance  is  the  section  in  the 
lower  right  hand  corner  of  Figure  1.1  which  relates  to 
the  problem  all  military  commanders  face  in  justifying  to 
Congress  the  need  for  additional  dollars  for  the  sake  of 
readiness.  For  example,  in  defending  their  Id’’  S  budget 
submission,  the  U.S.  Navy  proposed  that  25.2  million  dol¬ 
lars  of  additional  flying  hours  were  needed  to  improve 
readiness.  Congress  refused  the  Navy's  request  and  indi¬ 
cated  that  it  was  unable  to  discern  the  readiness  defi¬ 
ciency  from  existing  reporting  systems  [24].  The  Air 
Force  has  the  same  problem  since  its  Unit  Capability 
Measurement  System  (TJCMS)  falls  short  of  accurately  iso¬ 
lating  specific  resource  deficiencies  which  degrade  capa- 
bili ty . 

Efficiency  assessment  relates  tc  all  of  the 
above  definitions  of  capability,  effectiveness  and  readi¬ 
ness  by  measuring  the  degree  of  achievement  of  established 
readiness  and  capability  goals  while  simultaneously  taking 
into  account  the  degree  of  resource  conservation.  These 


assessments  provide  information  which  will  aid  in  the 


identification  of  problems  and  the  elimination  of  ineffi¬ 
cient  processes  in  order  to  make  the  best  use  of  available 
resources . 

The  budget  process  is  one  area  which  would  bene¬ 
fit  greatly  from  efficiency  assessments.  Budgets  which 
are  based  on  averages  of  past  expenditures  in  all  units, 
inefficient  as  well  as  efficient,  and  which  do  not  correct 
for  inefficiencies,  lead  to  serious  overestimations  of 
resource  requirements.  In  such  cases,  public  money  is 
funding  inefficiencies  when  other  worthwhile,  efficient 
programs  (military  or  nonmilitary)  could  make  better  use 
of  the  funds.  Instead,  budget  requirements  should  be 
estimated  based  on  data  collected  from  units  operating  on 
the  frontiers  of  efficiency  as  shown  in  Figure  1.2,  which 
implies  that  military  services  should  make  every  effort  to 
detect  inefficiencies  and  locate  frontiers  of  efficiency. 

This  does  not  mean  that  budgets  of  inefficient 
units  should  be  cut  arbitrarily.  In  view  of  the  widespread 
belief  that  current  military  capabilities  fall  short  of 
that  needed  to  counter  the  threat,  a  belief  which  is  repre¬ 
sented  by  the  shortfall  area  in  Figure  1.2,  it  would  be 
unwise  to  cut  budgets  until  capability  reaches  acceptable 
levels.  A  better  approach  would  be  to  detect 
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Budgeting  Based  on  Frontiers  of  Efficiency 


inefficiencies,  adjust  substandard  units  to  achieve  desire 
levels  of  efficiency,  and  redistribute  resources  among 
efficient  units  to  increase  overall  capability. 

Efforts  are  already  underway  at  the  Pentagon  to 
develop  a  capability  based  Planning,  Programming  and  Bud¬ 
geting  System  (PPBS).  Many  study  agencies  are  contributin 
through  several  parallel  initiatives  to  solve  different 
pieces  of  the  puzzle  [4l]. 

One  such  initiative  is  the  Mission  Area  Analysis 
(MAA)  program.  To  quote  Lt.  Col.  Nolte,  one  of  the  key 
Analysts  during  the  early  stages  of  MAA  development  [40], 


Essentially,  the  Mission  Area  Analysis  program  will 
identify  Air  Force  mission  requirements  and  the 
capabilities  to  support  them  in  both  current  and 
future  years.  In  those  cases  where  there  is  not  a 
100  percent  capability,  the  deficiencies  will  be 
identified  and  prioritized  in  a  logical  manner. 

This  prioritized  list  of  needs  will  influence  the 
way  in  which  resources  are  funded. 


MAA  seeks  to  answer,  "What  resources  will  be 
required  to  conduct  missions  which  will  effectively  counte 
the  future  threat,  and  are  existing  programs  adequate  to 
accomplish  current  and  future  missions?"  On  the  other 
hand,  Commanders  are  also  interested  in  the  following 


Questions 


"Can  Air  Force  units  accomplish  the  missions 


presently  required  by  war  plans  with  existing  resources? 
If  not,  what  corrective  actions  can  be  taken?" 

In  other  words,  MAA  should  attempt  to  determine 
the  best,  most  cost-effective  mix  of  forces  (resources) 
required  in  future  programs  to  counter  projected  threats; 
but  capability  assessment  must  also  provide  managerial 
information  to  assess  what  can  be  accomplished  with  the 
existing  mix  of  forces  (resources)  regardless  of  whether 
the  mix  is  best  or  not  (see  Figure  1.2).  Of  course,  both 
problems  must  somehow  address  the  relationship  between 
inputs  and  outputs  of  decision  making  units,  e.g.,  squad¬ 
rons  and  wings.  At  the  higher  levels  of  command,  these 
efficiency  and  capability  determinations  would  ideally 
form  the  basis  upon  which  allocations  of  funds  and  dis¬ 
tribution  (redistribution)  of  material  assets  would  be 
made  to  produce  a  more  effective  and  efficient  force 
structure. 

Capability  information  to  support  corporate 
planning  efforts  like  MAA  is  extracted  from  operational 
organizations  such  as  shops,  squadrons,  wings,  joint  task 
forces,  etc.,  and  aggregated  for  use  in  the  corporate 
planning  models.  These  combat  capable  organizations  (de¬ 
cision  making  units)  are  charged  with  the  responsibility 


of  insuring  weapon  systems  and  personnel  are  combat  ready. 
All  managers  and  technicians  in  these  combat  organizations 
must  be  capability  oriented,  and  they  must  continually 
strive  to  derive  from  each  weapon  system  its  primary  mis¬ 
sion  potential.  Supporting  analytical  models  are  needed 
which  enable  unit  level  managers  and  headquarters  analysts 
to  assess  efficiency  and  effectiveness  of  their  operations 

It  is  beyond  the  scope  of  this  study  to  provide 
solutions  to  all  the  problems  associated  with  monitoring, 
reporting  and  controlling  unit  effectiveness  and  effi¬ 
ciency.  The  foregoing  discussion  simply  provides  a  back¬ 
drop  of  Air  Force  problems  and  interests  which  serve  as 
motivation  for  this  research. 

This  study  will  present  DEA  theory  and  exten¬ 
sions  which  enable  the  location  and  analysis  of  empiricall 
determined  frontiers  of  efficiency  for  a  given  set  of 
similar  units,  e.g.,  wings.  Such  analytical  capabilities 
are  needed  in  establishing  effectiveness  oriented  program¬ 
ming,  planning  and  budgeting  systems  and  models  in  the 
Air  Force. 

Problems  of  Measurement  and  Evaluation 

The  Air  Force  is  a  public  service  organization 
and  as  such  encounters  many  of  the  difficulties  of 
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efficiency  measurement  and  evaluation  encountered  by  other 
public  agencies.  These  difficulties  frustrate  efforts  of 
problem  detection  and  corrective  action. 

One  of  the  most  important  limitations  heretofore 
obstructing  the  measurement  of  efficiency  in  the  Air  Force 
has  been  the  fact  that  absolute  measures  of  efficiency 
are  not  practical  for  combat  units.  If  one  were  able  to 
specify  the  maximum  achievable  sortie  production  of  a 
tactical  fighter  wing,  given  certain  levels  of  resource 
consumption,  then  the  efficiency  of  the  wing  might  be 
measured  by  dividing  the  actual  sortie  production  by  the 
maximum  achievable  sortie  production. 

But  no  production  function  has  yet  been  devel¬ 
oped  which  can  forecast  maximum  sortie  potential  given  the 
multitude  of  possible  input  (resource)  combinations  and 
environmental  conditions.  Thus,  the  Air  Force,  in  assess¬ 
ing  its  units,  must  rely  on  "relative"  measures  of  effi¬ 
ciency  from  empirically  based  comparisons  of  input  and 
output  levels. 

To  date,  the  typical  approach  in  assessing  unit 
performance  has  been  to  use  a  large  number  of  "partial" 
measures  (usually  ratios  and  percentages)  arranged  in 
tables  in  a  variety  of  different  ways  [44].  Managers  and 


analysts  review  these  tables  in  hopes  of  spotting  problem 
areas  which  can  then  be  more  closely  scrutinized  through 
follow-on  analyses.  This  review,  hampered  by  the  analysts 
limited  ability  to  assimilate  and  simultaneously  assess 
large  sets  of  data,  often  leads  to  ill-advised  follow-on 
investigations  and  erroneous  conclusions. 

Furthermore,  Air  Force  units,  like  other  public 
service  organizations,  have  inputs  and  outputs  which  are 
extremely  difficult  to  define  and  measure.  For  example, 
what  does  the  input  "workforce''  mean  and  how  should  it  be 
measured?  How  should  one  measure  "effective  combat  sor¬ 
ties?"  An  additional  complication  stems  from  the  fact 
that  multiple  inputs  and  outputs  of  these  units  are  seldom 
(if  ever)  expressed  in  common  units  of  measure,  and  the 
causal  relationships  linking  inputs  to  outputs  have  usu¬ 
ally  not  been  defined  mathematically. 

As  an  outcome  of  these  difficulties,  the  Air 
Force,  in  its  evaluations  of  unit  efficiency,  frequently 
relies  on  measures  which  are  production  correlates  or 
surrogates  for  several  variables,  where  relationships  are 
implied  but  not  proven.  For  example,  the  average  number 
of  aircraft  that  are  mission  capable  at  any  particular 
time  might  be  used  as  a  comparative  measure  of  the  ability 


of  aircraft  maintenance  units  to  keep  their  aircraft  fleets 


in  combat  ready  condition.  Obviously,  there  are  other 
factors  besides  maintenance  capability  (e.g.,  aircraft 
reliability  and  usage)  which  would  affect  this  average. 

Further  evaluation  difficulties  are  encountered 
because  of  differences  in  the  designed  operational  capa¬ 
bility  of  units.  All  military  units  are  designed  or  en¬ 
gineered  to  produce  a  given  amount  of  capability  in  per¬ 
forming  a  given  set  of  missions  with  a  given  (authorized) 
set  of  resources  [41].  This  variety  of  missions  frus¬ 
trates  attempts  to  compare  the  relative  efficiency  of 
combat  units.  For  example,  it  would  be  very  difficult, 
or  perhaps  fruitless,  to  compare  the  efficiency  of  a 
small  helicopter  detachment  and  a  large  strategic  airlift 
wing.  On  the  other  hand,  given  that  two  alternative  units 
of  the  same  type  are  designed  to  perform  the  same  mission 
(same  outputs),  then  an  efficiency  comparison  would  be 
quite  useful  in  determining  which  one  is  best. 

As  a  way  of  getting  around  this  problem  of  unit 
variability,  the  Air  Force  often  resorts  to  the  use  of 
broad  measures,  which  can  be  applied  to  all  units,  but 
which  have  questionable  meaning.  One  such  measure  is 
"percent  fill"  of  authorized  resources,  an  input  measure 


which  is  the  ratio  of  on-hand  assets  to  authorized  assets. 
While  thoughtfully  applied,  this  measure  leaves  much  to  be 
desired.  It  is  possible  for  two  units  to  have  the  same 
percent  fill  measure  while  one  unit  lacks  mission  essential 
assets  and  the  other  lacks  nonessential  assets.  Further¬ 
more,  it  is  possible  for  a  unit  to  have  all  authorized 
assets  and  still  be  inefficient  or  incapable  of  performing 
up  to  standards. 

Environmental  conditions  should  also  be  taken 
into  account  when  comparing  the  performance  of  Air  Force 
combat  units.  Severe  changes  in  environmental  factors 
such  as  temperature  and  moisture  can  induce  failures  in 
aircraft  systems,  particularly  the  electronic  ones.  Fur¬ 
thermore,  aircraft  do  not  fly  in  severe  weather,  thus, 
weather  can  significantly  affect  maintenance  and  sortie 
production.  If  efficiency  differences  are  to  be  adequately 
explained,  conditions  such  as  these  must  be  accounted  for. 

Before  the  development  of  the  DEA  model,  which 
will  be  presented  in  the  next  section,  difficulties  such 
as  those  described  above  appeared  to  be  insurmountable, 
thus  limiting  the  development  and  use  of  comprehensive 
efficiency  models  in  the  Air  Force  and  other  public  agen¬ 
cies.  But  DEA  now  offers  a  way  to  combine  multiple  inputs 


and  outputs  into  a  single  measure,  and  meaningful  effi¬ 
ciency  evaluations  can  now  be  obtained  with  much  less 
difficulty. 

Data  Envelopment  Analysis  (DEA) 

In  this  section,  the  DEA  model  and  its  charac¬ 
teristics  will  be  discussed.  There  are  many  publications 
available  which  thoroughly  document  the  theory  and  appli¬ 
cation  of  DEA.  Only  a  small  part  of  this  reference  ma¬ 
terial  will  be  summarized  here,  together  with  a  few  perti¬ 
nent  observations  about  the  DEA  model.  See  Chapter  II  for 
a  more  thorough  review  of  past  work. 

The  DEA  Model 

Suppose  one  wishes  to  compare  the  efficiency  of 
n  decision  making  units  (DMUs),  each  of  which  uses  varying 
amounts  of  m  inputs  and  produces  varying  amounts  of  s  out¬ 
puts.  Using  notation  conventions  similar  to  those  used  by 
DEA's  developers,  A.  Charnes,  W.  W.  Cooper  and  E.  Rhodes 
[19],  let: 

=  the  amount  of  input  type  i  used  by  DMU  j  during 
the  period  of  observation,  i  =  1,2, . . . , m  and 


yri  =  the  amount  of  output  type  r  produced  by  DMU  j 

during  the  period  of  observation,  r  =  l,2,...,s 
and  j  =  1,2,. . . , n . 

=  the  amount  of  input  type  i  used  by  the  unit  k 
where  k  c  j  =  (l,2,...,k,...,n)  and  unit  k  is 

the  DMU  being  evaluated.  Each  DMU  in  turn  will 
be  evaluated. 

yr^  =  the  amount  of  output  type  r  used  by  DMU.  . 

h^  =  the  efficiency  value  sought  for  DMU^ . 

vik  =  the  multipliers  fo.  each  input  type  i  which  will 
be  determined  by  solution  of  the  model  for 
unit  k . 

urk  =  the  multipliers  for  each  output  type  r  which 

will  be  determined  by  solution  of  the  model  for 
unit  k. 


The  following  model  formulation  is  used  to  de¬ 
termine  h^,  the  efficiency  rating  of  any  specified  DMU^ , 
from  among  the  j  =  1 , 2 , . . . , k , . . . , n  units: 
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Xj ’ srk’ sik  -  0  for  a11  ^  '  r>  and  i 
c?k  unrestricted. 

The  mathematical  theory  and  proof  governing  this 
transformation  can  be  found  in  articles  by  Charnes,  Cooper 
and  Rhodes  [  18 ,  19]  and  will  not  be  repeated  in  this  study 
But  there  are  a  few  model  characteristics  which  are  worth 
noting  her e  . 

First,  the  efficiency  measure  h^  is  a  scalar 
ratio  measure.  Secondly,  the  constraints  of  the  primal 
problem  insure  that  the  maximum  achievable  value  of  hk  is 
1.  And,  the  multipliers,  urk  and  vik,  will  be  computed 
in  such  a  way  that  the  unit  being  evaluated  will  receive 
the  highest  hk  value  possible,  i.e.,  no  other  feasible 
values  of  these  multipliers  will  produce  a  higher  effi¬ 
ciency  rating  for  DMU^ .  The  requirement  that  multipliers 
be  positive  insures  that  all  inputs  and  outputs  have  an 
effect  on  the  final  rating.  Furthermore,  DEA  does  not 
require  that  outputs  or  inputs  have  common  scales  or  units 
of  measurement,  an  important  attribute  when  dealing  with 
difficulties  such  as  nonmonetary  objectives  and  nonpur- 


chased  resources.  However,  all  measured  input  and  output 
values  are  required  to  be  strictly  positive. 


A  fact  not  so  readily  apparent  in  the  formula¬ 


tion  is  that  two  DMUs  can  be  rated  efficient  even  when  the 
patterns  or  mixes  of  their  inputs  and  outputs  are  quite 
different.  Differences  in  managerial  strategy  and  emphasis 
are  treated  fairly  by  the  DEA  model.  Each  unit  is  com¬ 
pared  to  others  in  the  set  which  have  similar  input/output 
mixes,  i.e.,  those  units  in  its  "neighborhood." 

DEA  can  identify  units  which  are  efficient  or 
inefficient  relative  to  a  frontier  of  actual  achievement; 
it  can  provide  a  limited  number  of  clues  on  possible 
causes  from  analysis  of  slack  variables  and  multipliers; 
and  it  might  be  of  some  help  in  evaluating  alternative 
management  actions  but  only  when  managerial  judgement 
plays  a  dominant  role  in  the  decision. 

Furthermore,  the  limited  amount  of  managerial 
information  currently  provided  by  DEA  is  a  major  improve¬ 
ment  over  the  inadequate,  partial  (and  sometimes  inaccu¬ 
rate)  measures  of  performance  which  are  now  typically  in 
use  in  many  public  service  organizations.  In  addition  to 
its  usefulness  as  a  performance  monitoring  device,  this 
efficiency  analysis  tool,  augmented  by  the  new  theory  and 
models  discussed  later  in  this  study,  opens  the  door  for 
further  development  and  growth  in  other  areas  of  planning, 
resource  allocation  and  decision  support. 


Evolution  into  Decision  Support 

The  application  of  DEA  to  problems  of  management 
in  various  fields  is  in  its  infancy.  Enough  progress  has 
been  made  to  support  an  optimistic  prognosis  for  its  use 
in  identifying  efficient  and  inefficient  management  units, 
but  extensions  beyond  that  are  still  being  formulated. 

Much  of  the  difficulty  of  applying  DEA  to  man¬ 
agement  control  and  planning  comes  from  the  nature  of  de¬ 
cision  making.  Improvements  in  organizational  efficiency 
often  require  strategic  decisions  affecting  changes  in 
output  goals,  input  mixes  or  the  underlying  technologies 
employed  by  the  organization.  Strategic  decisions  are 
generally  novel,  complex  and  open-ended  requiring  managers 
to  generate  and  explore  solution  possibilities  with  lim¬ 
ited  knowledge  of  the  situation  [38]. 

Typically,  these  decisions  have  no  obvious  cor¬ 
rect  answers  and  often  require  "what-if"  analyses.  In 
such  situations,  managers  are  forced  to  make  qualitative 
judgements;  and  the  degree  to  which  quantitative,  analyti¬ 
cal  techniques  are  used  largely  depends  on  the  amount  of 
knowledge  available. 

These  unstructured,  nonquantitative  processes 
are  often  necessary  when  decision  situations  have  not  been 


previously  encountered  in  quite  the  same  form  and  where 
there  exists  no  known  set  of  ordered  responses.  In  such 
situations,  managers  rely  almost  entirely  on  judgement, 
intuition,  and  experience.  Somewhere  between  the  well- 
structured  and  unstructured  extremes  lies  many  of  the 
strategic  efficiency  decisions  which  could  be  evaluated 
advantageously  using  a  combination  of  judgement  and  mathe¬ 
matical  programming.  In  such  "semi-structured"  decision 
processes,  clear  analytic  relationships  can  reduce  un¬ 
certainty  and  enable  experienced  managers  to  focus  on 
variable  interactions,  interpretations  and  situational 
value  judgements  which  are  not  explicitly  represented  in 
the  analytic  models.  Solutions  of  these  semistructured 
problems  might  require  several  iterations  of  modeling  and 
evaluation,  each  iteration  containing  components  of  both 
structure  and  judgement,  until  a  limited  number  of  choices 
have  been  examined  and  an  acceptable  (usually  nonoptimal) 
alternative  has  been  chosen. 

All  of  these  points  suggest  that  production 
frontier  analysts,  including  those  using  DSA,  must  be  wary 
of  imposing  sophisticated  but  possibly  incomplete  analyti¬ 
cal  models  onto  semistructured  problems.  The  lack  of 
complete  knowledge  and  understanding  of  production 


processes,  typically  encountered  in  organizations  without 
scientifically  engineered  operations,  results  in  the  fol¬ 
lowing  familiar  frontier  analysis  difficulties: 

1.  Identification  of  a  comprehensive  set  of 
outputs  and  inputs  depends  upon  more  advanced  understand¬ 
ing  of  production  technologies  than  is  the  case  in  most 
social  service  applications. 

2.  Input  measures  are  all  treated  at  the  same 
level  in  present  uses,  but  they  may  interact  in  complex 
ways.  Some  inputs  are  hierarchically  related,  for  example, 
in  means-ends  chains.  Other  inputs  are  at  the  same  level, 
but  threshold  effects  on  one  may  constrain  the  effective 
use  of  others  in  producing  outputs. 

3.  Weak  causal  relationship  between  inputs  and 
outputs  resulting  from  inadequate  understanding  of  pro¬ 
duction  processes  may  be  further  weakened  by  inefficiencies 
in  the  use  of  resources  even  among  the  most  efficient 
units.  This  places  limitations  on  the  confidence  with 
which  resource  reallocation  decisions  can  be  made. 

4.  Organizations  whico.  are  engaged  in  produc¬ 
tion  of  the  same  outputs  with  the  same  kind  of  resources 
are  likely  to  be  subunits  of  more  complex  organizations. 
Elementary  schools,  for  example,  are  organized  into 


districts  and  Air  Force  squadrons  are  within  wings.  Satis 
factory  techniques  for  aggregating  efficiencies  have  not 
been  developed. 

5.  Knowledge  of  inefficiencies  in  an  organiza¬ 
tion  calls  for  diagnosis  of  the  intervening  processes  by 
means  of  which  inputs  are  used  to  produce  outputs.  An 
output-input  model  may  indicate  pathologies  but  gives  few 
hints  as  to  the  cause  or  cure. 

All  of  the  above  difficulties  have  prevented 
progress  from  being  made  in  identification  of  production 
functions  in  the  not-for-profit  sector.  DEA  provides  hope 
for  limited  progress  by  circumventing  some  of  the  diffi¬ 
culties.  It  makes  no  assumptions  about  industry-wide  pro¬ 
duction  functions,  but  uses  empirical  observations  to 
measure  efficiency  relative  to  local  frontiers.  No  claim 
needs  to  be  made  for  demonstrated  causality  between  inputs 
and  outputs  since  unspecified  processes  are  the  causal 
agent  and  the  model  allows  for  an  unknown  amount  of  in¬ 
efficiency  to  exist. 

But  further  development  is  necessary  to  realize 
the  full  potential  of  DEA  as  a  management  tool.  To  men¬ 
tion  only  one  such  area,  an  additional  need  of  efficiency 
frontier  analysts  and  researchers  is  a  decision  support 


system  for  organizational  modeling  and  analyses  which  coul 
very  well  lead  to  greater  understanding  of  the  production 
process  and,  in  some  cases,  make  possible  the  estimation 
of  frontiers  with  parametric  and  stochastic  models. 

Decision  support  work  has  already  begun.  Rele¬ 
vant  theory  has  been  extended  by  this  study  (see  Chap¬ 
ter  III)  and  software  is  being  developed  for  a  second 
stage  model. 

Semi  structured  planning  decisions  of  particular 
interest  in  this  study  relate  to  the  questions,  "What  out¬ 
put  goals  should  an  inefficient  unit  adopt,  and  what  re¬ 
source  levels  should  it  expect  to  use  in  the  next  produc¬ 
tion  period  in  order  for  the  unit  to  achieve  an  efficient 
rating?"  In  its  present  state,  DEA  computes  such  "values- 
if- efficient "  for  organizational  units  as  follows: 

xik  =  h£  xik  -  s  ik  >  1  =  l-;2**'*-111  (1.4) 

y rk  "  yrk  +  srk  ’  r  =  1,2,  .... s 

*  —  *  i. 

where  h^,  s  ^  an*i  srk  are  ^EA  efficiency  and  slack 

values  at  optimality.  But  these  formulas  can  produce 
values  which  are  unreasonable  from  a  decisionmaker's 
viewpo i nt . 

Now  suppose  input  x^  is  nondiscretionary,  i.e., 
management  cannot  control  its  changes.  Furthermore. 


suppose  this  input  has  positive  slack,  s  ^  >  0  associated 

with  it  at  optimality.  The  adjustment  to  the  frontier 

obtained  from  the  Charnes,  Cooper  and  Rhodes  DEA  model 

presented  in  Section  D  produces  a  value-if- efficient  of 
^  *  -  * 

xik  =  hk  *  xik  "  sik  w’nic!l  is  less  than  xiJc.  Having  no 
control  over  this  input,  managers  in  organization  k  would 
consider  the  prospect  of  changing  to  the  reduced  amount 
xik  be  unreasonable. 

An  alternative  value-if- efficient  adjustment 
will  be  presented  in  this  thesis,  one  which  determines  a 
frontier  point  for  unit  k  having  the  same  vector  of  in¬ 
puts.  This  approach  differs  from  the  method  suggested 
by  Banker,  Charnes,  Cooper  and  Shinnar  [4]  which  was  to 
remove  slack  from  nondiscretionary  inputs  before  recom¬ 
puting  efficiency. 

The  presence  of  slack  or  surplus  values  in  large 
amounts  creates  another  problem  which  must  be  solved  to 
increase  the  value  of  DEA  information.  Such  large  values 
can  cause  significant  overestimations  of  efficiency.  The 
fact  that  slack  is  present  means  the  organizational  unit  k 
being  evaluated  is  not  "tightly"  enveloped  by  a  frontier 
facet;  i.e.,  at  optimality,  either  the  input  vector  Xk  or 
the  output  vector  is  no  t  a  linear  combination  of  ob¬ 
served  values  from  the  frontier  facet.  In  other  words. 


the  organization  k  is  tightly  enveloped  if  all  slacks  are 
zero  implying: 


a*t  Yr  =  yrk 


(1 


a*c 

A  Xi  =  hkxik 


A*T  >  o 


where  A  *T  =  ,  .  .  .  ,\*)  >  Y1  =  (  yr  1 ,  yr  2  ,  .  .  .  ,  yr  q  )  and 

Y i  =  (xn  >xi  ?  >  •  •  •  >xf  „  )  • 


Other  researchers  interested  in  the  application 
of  DEA  have  encountered  this  problem  of  efficiency  over¬ 
estimation  [ll,  37,  42],  a  difficulty  which  is  related  to 
the  use  of  the  no n- Archimedean  e  (infinitesimal).  From  a 
manager's  viewpoint,  the  situation  in  which  a  unit  is  no  t 
tightly  enveloped  can  result  in  ludicrous  efficiency  esti 
mates.  Dr.  Jack  Davidson,  Superintendent  of  Tyler  Inde¬ 
pendent  School  District  and  member  of  the  Educational 
Productivity  Council  (EPC)  in  Texas,  asked  ".  .  .  Is  it 

really  possible  that  a  school  with  45  out  of  50  minutes 
wasted  in  instructional  time  can  be  99$  efficient?"1  The 
answer  is  no. 

1The  DEA  methodology  is  the  primary  tool  used  b 
the  EPC.  Dr.  Davidson  male  this  remark  in  the  presence  o 
50  other  Texas  superintendents  during  the  summer  1991 
session  of  the  EPC. 


The  cause  of  serious  errors  in  estimation  like 
that  noted  by  Dr.  Davidson  can  best  be  illustrated  by 
examining  the  results  of  a  DEA  evaluation  of  the  single 
output,  two  input  case  shown  in  Figure  1.3. 

This  figure  depicts  five  units,  all  producing  a 
single  output  amount  of  one.  Three  of  the  units  (A,  3  and 
C)  would  be  classified  as  efficient  by  DEA;  and  the  re¬ 
maining  two,  D  and  E,  would  be  inefficient  since  they  use 
greater  amounts  of  input  to  achieve  the  same  output  when 
compared  to  the  frontier  segments. 

The  information  generated  by  this  DEA  evaluation 
is  shown  in  Table  1.1.  The  points  =  (l/<=,  0)  and  Mg  = 
(0,  l/e)  are  treated  as  fictitious  units.  They  can  and 
do  appear  in  some  optimal  bases.  Any  frontier  segment 
containing  one  of  these  units  (e.g.,  is  in  the  basis  of 
unit  E )  is  artificial  in  the  sense  that  only  one  of  its 
basis  units  is  an  actual  unit. 

In  the  case  of  unit  E,  the  presence  of  in  its 
basis  caused  a  serious  overestimation  of  efficiency  and 
an  arbitrarily  large  fictitious  rate  of  substitution  (-  l/e  ) 
associated  with  the  segment  .  The  case  of  unit  D  is 
preferable.  Unit  D  is  fully  enveloped  by  the  facet  con¬ 
necting  A  and  B.  Its  efficiency  measure  h  ^  =  .67  and  the 
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TABLE  1.1 

DEA  Evaluation  of  the  Single  Output.  Two  Input  Case 


Units 


Efficiency 

(S) 


Associated 

Frontier 

Segments 

(Basis 

Units) 


Rates  of  Input 
Substitution 
Along  Segments 
/ox  A 


Slack 

Amounts 


B 

or  AM^ 

or  -c 

0 

0 

3 

or  BC 

-4  °r  -1 

0 

0 

ic 

or  CM 

-1  or  -1/  e 

0 

0 

[b 

l 

"2 

0 

0 

-l/e 

2 

0 

ewe 


rate  of  substitution  along  the  segment  AB  are  more  mean¬ 
ingful  and  interpretable. 

The  problem  of  overestimating  unit  E  efficiency- 
can  be  dramatically  demonstrated  by  steadily  increasing 
the  amount  of  input  x^E  of  unit  E  from  6  to  100,004  while 
holding  the  output  yE  and  Xg  values  constant  (  yE  =  1  and 
X2E  =  at  their  original  values.  This  in  effect  steadily 
increases  the  slack  variable  s"^,  from  2  to  100,000.  Fig- 
ure  1.4  shows  graphically  that  when  e  =  10"  ,  an  increase 

in  slack  from  2  to  100,000  will  reduce  the  efficiency 
measure  hE  from  1.0  to  .9.  Returning  to  Dr.  Davidson's 
question,  how  can  a  unit  which  has  y£  =  1,  x1E  =  100,004 
(slack  sj_E  =  100,000)  and  x2E  =  1  be  nine-tenths  as  effi¬ 
cient  as  one  having  y£  =  1,  x^E  =  4,  x2E  =  1? 

A  preferred  approach  would  be  to  measure  the 
efficiency  of  unit  E  relative  to  the  extended  frontier 
point  Q  in  Figure  1.3,  where  Q  is  a  linear  combination  of 
nearby  efficient  units  3  and  C.  Of  course,  units  which 
are  fully  enveloped  like  D  should  be  evaluated  as  before. 
Furthermore,  the  fictitious  units  and  M2  should  be 
disallowed . 

For  the  simple  example  described  above,  this 
new  approach,  together  with  DEA,  would  provide  the  infor¬ 
mation  shown  in  Table  1.2. 


Efficiency 


hk 


Rates  of  Input 
Substitut ion 
Associated  Along  Segments 
Frontier  Segments  °  xi 

(Basis  Units)  <^2 


I 


Slack 

Amounts 


s 


2k 


Units 


In  this  approach,  when  units  are  not  fully  en¬ 
veloped,  informa tion  is  drawn  from  the  nearest  complete 
facet  in  determining  the  efficiency  rating  and  rates  of 
substitution.  The  efficiency  ratings  thus  determined  are 
essentially  lower  bounds  in  contrast  to  the  "upper  bound" 
overestimation  of  DEA.  For  fully  enveloped  units,  these 
bounds  coincide. 

Figure  l.F  compares  the  ratings  of  unit  E  ob¬ 
tained  from  DEA  with  those  of  the  new  approach  for  increas 
ing  amounts  of  slack.  As  noted  before,  DEA  is  relatively 
insensitive  to  increases  in  slack,  but  the  new  approach 
provides  more  realistic  decreases  in  efficiency  in  re¬ 
sponse  to  the  increases  in  slack. 

Specific  Statement  of  Study  Purpose 

The  example  presented  in  the  last  section  is 
misleadingly  simple.  In  evaluation  of  the  single  output, 
two  input  case,  one  has  the  advantage  of  being  able  to 
graphically  represent  the  problem  and  manually  compute  a 
solution.  Unfortuna tely ,  the  methods  used  in  that  example 
cannot  be  automatically  generalized  to  the  multiple  out¬ 
put,  multiple  input  case. 


3 


Figure  1 .5 

PEA  (at  s  =  IQ'6)  Compared  to  New  Approach  in  Measuring 
Decreases  in  Efficiency  Caused  by 
Increasing  Slack 
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Nonetheless,  solution  of  the  aforementioned  prob¬ 
lems  in  a  multiple  input,  multiple  output  situation  is 
absolutely  necessary.  In  all  field  implementations  or 
demonstrations  of  DEA  known  to  this  author,  the  presence 
of  significant  amounts  of  slack  and  the  lack  of  full  en¬ 
velopment  of  inefficient  units  is  the  rule  rather  than  the 
exception.  In  fact,  the  1982  EPC  evaluation  of  Texas 
schools  revealed  that  about  60  percent  of  all  schools  were 
inefficient  (over  300  inefficient  ratings);  and  all  of 
these  units  had  significant  positive  slack  values  and  fic¬ 
titious  non- Ar ch imede an  vectors  in  their  bases,  suggesting 
of  course  that  the  efficiency  measures  were  seriously 
overestimated. 

The  fundamental  purpose  of  this  study  is  to 
eliminate  these  problems  by  developing  a  new  second  stage 
model  for  use  in  multiple  output,  multiple  input  situa¬ 
tions,  a  model  which  locates  a  nearby  efficient  facet  as 
a  basis  for  evaluating  each  partially  enveloped  ineffi¬ 
cient  unit,  which  calculates  the  lower  bound  of  efficiency 
of  each  such  unit  relative  to  this  facet,  and  provides 
legitimate  ( nonf i c ti tio us )  rates  of  substitution. 

The  next  chapter  contains  a  brief  review  of  the 
supporting  theory  and  applications  relevant  to  this 
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purpose.  Then,  in  Chapter  III,  the  new  second  stage  model 
will  be  presented  together  with  definitions,  properties 
and  proofs  including  the  conditions  under  which  solutions 
exist  as  well  as  alternate  ways  of  generating  frontier 
projections  to  obtain  "values  if  efficient.”  In  Chapter  IV 
the  new  model  will  be  tested  on  a  representative  Air  Force 
multiple  input,  multiple  output  problem.  The  efficiency 
of  combat  wings  will  be  assessed  using  DEA  and  the  new  sec¬ 
ond  stage  model,  and  the  results  will  be  compared  to  those 
obtained  from  use  of  DEA  alone.  And,  finally,  conclusions 
of  the  study  recommendations  for  further  work  will  be  sum¬ 
marized  in  Chapter  V. 

In  support  of  this  research,  software  is  under 
development  which  will  enable  interactive  data  base  manipu¬ 
lation  and  modeling.  These  new  computer  capabilities, 
together  with  extant  DEA  and  second  stage  models,  will 
form  the  basis  for  the  initial  prototype  of  a  decision 
support  system.  Experience  gained  from  the  prototype  sys¬ 
tem  will  enable  managers,  analysts,  and  researchers  to 
make  use  of  efficiency  frontier  estimation  in  areas  of 
management  planning  which  heretofore  have  been  unsuitable 
for  application  of  efficiency  models.  In  any  event,  the 
evolution  of  this  decision  support  system  should  lead  to 


H  A  P  T  S  R 


EXTANT  DEA,  THEORETICAL  BEGINNINGS 
AND  APPLICATIONS1 


Introduct ion 


There  is  a  small  but  growing  body  of  literature 
in  the  theory  and  applications  of  DEA.  The  model  is  of 
particular  interest  to  (but  is  not  limited  to)  those  who 
study  or  manage  not-for-profit  enterprises,  since  it  pro¬ 
vides  a  way  to  take  multiple  outputs  and  multiple  inputs 
into  account  and  to  compute  an  efficiency  rating  for  each 
unit  relative  to  other  units  which  produce  the  greatest 
amount  of  outputs  for  their  inputs. 

Furthermore,  DEA  does  net  require  that  outputs 
or  inputs  have  common  scales  or  units  of  measurement,  an 
important  attribute  when  dealing  with  such  difficulties  as 
nonmonetary  objectives  and  nonpurchased  resources. 

1Much  of  the  material  in  this  section  was  ex¬ 
tracted  from  an  unpublished  paper  written  by  this  author 
together  with  Dr.  A.  Bessent  and  Dr.  W.  Bessent  of  the 
University  of  Texas  while  all  were  working  under  contract 
with  the  United  States  Air  Force.  This  author  is  greatly 
indebted  to  the  3essents  for  their  substantial  contribu¬ 
tions  in  organizing  and  writing  this  chapter. 
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Though  the  literature  of  DEA  has  relatively  few 
sources  at  present,  these  are  somewhat  scattered  in  dif¬ 
ferent  journals;  and  some  documents  are  in  technical  re¬ 
ports  of  limited  circulation.  Thus,  a  scholar  seeking 
ready  access  to  the  methodology  does  not  have  an  easy  en¬ 
try  point.  Hopefully  t.ois  will  be  remedied  by  means  of 
tne  present  review. 

In  the  following  sections,  material  will  be  pre¬ 
sented:  ( l)  to  relate  the  theory  of  Data  Envelopment 

Analysis  to  its  immediate  progenitors  in  the  literature  of 
frontier  estimation,  (2)  to  contrast  DEA  with  other  method¬ 
ologies  currently  employed  in  measuring  efficiency,  (3)  to 
review  the  various  applications  that  have  been  reported 
and  discuss  the  more  intractable  problems  that  have  been 
encountered,  and  (4)  to  suggest  ways  in  which  DEA  could  be 
used  for  management  purposes  other  than  efficiency  assess¬ 
ment  through  extensions  of  the  theory  and  improvement  of 
existing  software. 


Theory  Development 


Int  r oduc  t i on 

The  reader  who  is  familiar  with  the  recent  econ¬ 
ometric  methods  ably  reviewed  by  Forsund,  Lovell,  and 
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Schmidt  [23]  will  recognize  that  Data  Envelopment  Analysis 
is  classifiable  as  a  deterministic,  n on parame t r i c  model 
which  extends  M.  J.  Farrell's  work  [27]  in  that  area  to 
solution  of  the  multiinput  and  multioutput  case.  DEA  dif¬ 
fers,  however,  from  the  other  models  reviewed  in  the  pur¬ 
poses  for  which  it  has  been  employed. 

Many  other  models  are  concerned  with  industry¬ 
wide  frontier  estimation  and  only  secondarily  for  measur¬ 
ing  inefficiency  of  individual  firms.  Stochastic  models, 
for  example,  frequently  provide  estimates  of  efficiency 
frontiers  across  firms,  and  estimates  of  individual  firm 
inefficiencies  are  made  relative  to  these  across-firm 
f ront i e  r s . 

In  sharp  contrast,  DEA  is  employed  chiefly  to 
measure  the  efficiency  of  individual  firms  relative  to  a 
frontier  neighborhood  of  technically  efficient  firms. 

Thus  the  production  frontier  is  specific  to  the  firm, 
rather  than  to  the  industry. 

Several  consequences  of  this  different  perspec¬ 
tive  might  be  kept  in  mind  when  reading  the  following  re¬ 
view.  First,  DEA  results  are  intended  to  provide  manage¬ 


ment  information  for  a  firm  or  group  of  firms  rather  than 
to  study  the  production  technology  of  an  industry. 
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Secondly,  DEA  results  vary  relative  to  both  the  measure¬ 
ments  employed  and  the  selection  of  units  com  prising  the 
comparison  set  rather  than  producing  gene ra 1 izab  le  produc¬ 
tion  functions.  Thirdly,  DEA  permits  the  incorporation  of 
exogenous  factors  such  as  weather  that  in  other  models 
might  be  treated  as  random  disturbances  or  perhaps  might 
not  be  considered  at  all. 


Farrell  Efficiency 


Farrell's  purpose  was  to  provide  a  satisfactory 
measure  of  productive  efficiency  which  takes  into  account 
multiple  inputs  and  outputs  in  a  way  that  would  be  of  use 
to  a  wide  range  of  economic  statisticians,  theorists,  pol¬ 
icy  makers,  business  persons  and  civil  servants.  We  will 
summarize  this  method  for  the  case  where  two  factors  of 
production  (inputs)  are  used  to  produce  a  single  product 
(output).  Farrell's  explanation  of  this  simple  case  is 
briefly  paraphrased  below  because  of  its  relevance  to  the 
development  and  interpretation  of  DEA. 

Figure  2.1  provides  a  graphic  representation  of 
Farrell's  efficiency  concepts.  Curve  FF '  is  an  isoquant, 
which  represents  the  various  combinations  of  inputs,  x  ^ 


and  x 
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g,  which  can  be  used  by  perfectly  efficient  organiza¬ 
tions  to  produce  one  unit  of  output  y  -  f  (x-p  Xg),  assum¬ 
ing  constant  returns  to  scale.2  Because  perfectly  effi¬ 
cient  organizations  will  produce  the  largest  possible  out¬ 
put  from  any  given  input  combination,  points  between  the 
curve  FF '  and  the  origin  are  unattainable,  i.e.,  FF '  is 
a  frontier  of  production  so  that  it  is  impossible  to  ob¬ 
tain  a  unit  of  output  with  combinations  in  the  region  be¬ 
tween  FF '  and  the  origin. 

The  point  p  represents  the  observed  inputs  per 
unit  output  for  a  particular  organization.  The  point  q 
represents  an  efficient  organization  which  uses  the  same 
proportionate  mix  of  inputs;  i.e.,  if  p  has  the  input  com¬ 
bination  (  x^  ,  X2D)>  then  there  exists  a  real  number  t 
such  that  (xj_p,  Xgp)  =  t  (x^,  Xg^)  .  If  we  let  op  and  oq 
represent  the  distances  from  the  origin  to  points  p  and  q 
respectively,  then  t  =  oq/op  which  means  that  an  organiza¬ 
tion  represented  by  q  can  produce  one  unit  of  output  with  J 


2An  assumption  of  "constant  returns  to  scale"  is 
required  to  permit  all  relevant  information  to  be  repre¬ 
sented  by  this  diagram;  that  is,  we  must  assume  f  (tx^, 
tXg)  =  tf  (x^,  Xg)  which  implies  1  =  f  (x-^/y,  Xg/y).  Far¬ 
rell  also  discusses  economies  and  diseconomies  of  scale 
which  could  cause  measurement  difficulties  if  there  are 
large  variations  in  the  level  of  output  produced. 


only  a  fraction,  oq/op,  of  the  inputs  that  p  uses.  From 
another  viewpoint,  one  could  say  that  in  order  for  p  to  be 
as  efficient  as  q,  organization  p  should  produce  op/oq 
times  its  current  output.  Farrell  defined  the  ratio  oq/op 
as  the  "technical  efficiency”  of  the  organization  p.3 

In  order  to  draw  the  true  frontier  isoquant  FF '  , 
one  must  know  the  production  function.  Unfortunately, 
frontier  production  functions  are  very  difficult  to  derive 
for  complex  processes.  In  Farrell's  words,  "it  is  far  bet 
ter  to  compare  performances  with  the  best  actually 
achieved  than  with  some  unattainable  ideal."  That  is,  one 
should  use  an  observed  standard  rather  than  a  theoretical 
standard  when  little  is  known  about  the  true  frontier. 

Figure  2.2  shows  an  example  of  an  observed 
standard  in  the  form  of  a  piece-wise  linear  frontier  SS ' 
and  a  scatter  of  points  associated  with  observations  from 
a  number  of  organizations.  The  relative  efficiency  of  p 
can  now  be  measured  by  comparing  it  to  the  hypothetical 
organization  q  which  is  a  linear  combination  of  frontier 
points  a  and  b.  The  technical  efficiency  again  is 

3Farrell  also  defined  "price"  efficiency  and 
"overall"  efficiency  measures  which  are  not  germane  to 
this  discussion  but  might  be  of  interest  to  the  reader 


represented  by  oq/op .  Farrell  first  used  this  technique 
at  a  time  when  linear  programming  formulations  and  codes 
were  not  available  so  that  the  time  and  cost  of  computa¬ 
tions  were  prohibitive  even  for  relatively  small  prob¬ 
lems  [27]. 

Regardless  of  these  computational  problems, 
which  would  later  be  solved  by  Charnes,  Cooper,  and  Rhodes 
[19],  the  wort  of  Farrell  provided  a  major  breakthrough 
for  the  single  output  case  specifying  a  frontier  of  rela¬ 
tive  efficiency  without  designating  (assuming)  the  form  of 
the  industry  production  function . 

Subsequent  Development  of 
Deterministic  Models 


If  it  is  reasonable  to  assume  the  form  of  the 
production  function,  and  if  one  wishes  to  make  no  presump¬ 
tions  about  returns  to  scales,  then  a  second  approach 
might  be  useful,  i.e.,  compute  a  parametric  convex  hull  of 
observed  input-output  values  using  a  flexible  functional 
form  [28].  Aigner  and  Chu  [l],  the  first  to  follow  Far¬ 
rell's  suggestion,  specified  a  deterministic  parametric 
model  for  estimating  the  industry  production  function  for 
the  single  output  case  where  the  production  frontier  was 


assumed  to  have  a  simple  but  restrictive  Cobb-Douglas  func¬ 
tional  form.  The  model  estimates  the  parameters  of  the 
Cobb-Douglas  function  with  the  restriction  that  observed 
output  values  are  less  than  or  equal  to  the  estimated  val¬ 
ues;  meaning  that  all  error  terms  (residuals)  are  one¬ 
sided  below  the  frontier.  The  functional  is  fitted  to  the 
observations  by  minimizing  either  the  sum  of  residuals  or 
the  sum  of  the  squared  residuals.  Although  this  type  of 
formulation  is  simple  and  can  accommodate  nonconstant  re¬ 
turns  to  scale,  it  fails  to  deal  adequately  with  the  mul¬ 
tiple  output  characteristics  of  nonprofit  as  well  as  other 
entities. 

On  the  other  hand,  Charnes  and  Cooper  with 
Rhodes  ([18],  [19],  and  [43])  first  chose  the  alternate 

direction  of  providing  new  interpretations  and  extensions 
of  the  deterministic,  nonparametric  Farrell  efficiency 
measure,  and  then  with  Banker  and  Shinnar  [4]  extended 
their  theory  to  include  deterministic  parametric  produc¬ 
tion  functions  given  multiple  outputs.  Their  models  over¬ 
come  the  computational  difficulties  encountered  by  Farrell, 
and  provide  easy  treatment  of  the  multiple  output  case  for 
both  types  of  production  function  estimation.  This  was  ac¬ 
complished  by  redefining  efficiency  in  terms  of  a  nonlinear 


programming  model  which  has  a  linear  programming  equivaler. 
thereby  un leashing  the  theoretical  power  and  computation a  1 
capabilities  of  linear  programming  for  analyzing  efficienc 
and  interpreting  results.  Charnes,  Cooper,  and  Rhodes 
named  this  method,  Data  Envelopment  Analysis  (  DEA) . 

Banker,  Charnes,  Cooper,  and  Schinnar  [4]  fur¬ 
ther  extended  the  DEA  theory  to  include  parametric  effi¬ 
ciency  frontier  estimation  by  taking  into  account  multiple 
output  functions  which  are  piece-wise  0-linear  (includes 
both  log-linear  and  Cobb- Douglas )  thus  allowing  for  in¬ 
creasing,  decreasing  and  constant  returns  to  scale.  They 
also  showed  that  this  nonlinear  problem  is  reducible  to  a 
finite  sequence  of  linear  programming  problems  and  illus¬ 
trated  the  method  with  a  numerial  example.  Since  DEA  has 
not  yet  been  applied  to  industries  where  the  technological 
possibilities  of  input  to  output  transformations  by  operat 
ing  units  is  known,  this  methodology  has  not  been  ex¬ 
ploited. 

None  of  the  models  discussed  thus  far  addresses 
another  important  theoretical  question  which  needs  to  be 
answered  in  order  to  improve  the  potential  for  using  DEA 
as  a  basis  for  decision  support  and  management  planning: 
what  feasible  input  combinations  and  what  realistic  output 


goals  should  be  adopted  by  an  inefficient  organization  to 
insure  attainment  of  the  efficiency  frontier  without  de¬ 
creasing  the  organization's  effectiveness?  One  would  ex¬ 
pect  that  an  inefficient  organization  could  reach  the  fron 
tier  by  simply  reducing  inputs  or  increasing  outputs  (or 
both)  while  maintaining  the  same  relative  proportions  of 
inputs  and  outputs.  Unfortunately,  in  an  actual  operat¬ 
ing  environment  of  an  organization,  there  may  be  con¬ 
straints  which  fix  or  bound  inputs  and  otherwise  limit  the 
discretion  of  managers. 

A  "constrained"  extension  of  the  DEA  model  is 
needed  which  will  enable  managers  to  specify  such  limita¬ 
tions  so  that  results  can  be  obtained  which  are  both  real¬ 
istic  and  feasible.  Additional  decision  support  require¬ 
ments  also  need  to  be  investigated  with  the  intent  of  pro¬ 
viding  extended  interactive  computer  capabilities  for 
managerial  use.  Planners  and  analysts  should  be  able  to 
interact  with  efficiency  models  to  test  alternative  mixes 
or  alternative  levels  of  inputs  and  outputs. 

Comparisons  with  Related  Methodologies 

Measurement  of  efficiency  in  multiple  input, 
multiple  output  nonprofit  enterprises  has  been  an 


econometric  problem  which  has  not  yielded  satisfactorily 
to  other  analytical  models  that  have  been  applied  (see 
[8],  [9];  [  10  ] ,  [31],  and  [45]).  Reported  applications  of 

Data  Envelopment  Analysis  give  promise  that  evaluating  ef¬ 
ficiency  frontiers  in  certain  special  cases  can  be  achieved 
although  not  with  the  generalizability  sought  by  those  in¬ 
terested  in  production  functions  for  an  industry.  For- 
sund,  Lovell  and  Schmidt's  [28]  review  of  frontier  estima¬ 
tion  methods  gives  a  good  account  of  the  strengths  and 
limitations  of  recently  developed  econometric  models.  In 
contrast  to  the  methods  they  review,  with  the  exception  of 
Farrell's  early  work,  DEA  has  not  been  employed  to  deal 
with  the  problem  of  industry-wide  frontier  estimation  for 
which  the  other  econometrics  models  were  developed.  For 
this  reason,  comparison  of  DEA  with  statistical,  para¬ 
metric  or  stochastic  models  will  not  be  undertaken  here. 
Instead,  this  discussion  will  be  confined  to  the  methods 
that  have  been  compared  to  DEA  results  in  applications  re¬ 
ported  thus  far:  least  squares  regression  and  ratio  anal¬ 
ysis,  and  to  the  major  concerns  common  to  those  techniques. 
The  reader  is  probably  aware  of  other  concerns  and  un¬ 
answered  questions  pertaining  to  this  discussion.  Hope¬ 
fully,  the  limited  treatment  of  the  subject  presented  here 


will  suffice  for  -chose  who  are  already  well  informed  about 
these  and  other  methodologies. 

Regression 


Ordinary  least  squares  regressions  of  the  single 
output,  mult i pie- input  variety  having  both  positive  and 
negative  error  terms  produce  curves  of  average  relation¬ 
ship  [9],  [10],  [45].  These  curves  do  not  represent  fron¬ 

tiers,  which  by  definition  are  based  on  extremal  relations 
Actual  output  values  lie  above  and  below  the  regression 
curve,  and  the  outputs  of  efficient  units  are  not  neces¬ 
sarily  greater  than  their  corresponding  regression  esti¬ 
mates.  With  stochastic  models,  additional  information  is 
gained  by  decomposing  residuals,  but  for  frontier  estima¬ 
tion  in  the  type  of  problems  which  have  been  addressed  by 
DEA,  average  estimates  are  uninformative.  Furthermore,  in 
some  cases  the  size  and  direction  of  the  residuals  may  ap¬ 
pear  to  have  little  or  no  bearing  on  the  efficiency  mea¬ 
sure  (distance  from  the  frontier). 

A  major  difficulty  arises  in  the  multiple  output 
case  when  least  squares  regression  analysis  is  performed 
on  each  output  separately  [10]  and  [45].  The  other  out¬ 


puts  excluded  from  the  analysis  have  an  implicit  impact 


resources  . 


since  they  may  rely  on  (compete  for)  the  same 
Each  regression  equation  might  be  able  to  predict  ade¬ 
quately  an  expected  level  of  a  single  output  for  an  or¬ 
ganization,  assuming  this  organization  could  experience 
any  of  the  random  fluctuations  or  inefficiencies  of  the 
industry  (all  firms)  and  recognizing  that  the  influence  of 
other  outputs  are  implicitly  taken  into  account  by  the  de¬ 
viations  from  the  regression  line  (residuals).  But  these 
equations  cannot  predict  the  expected  output  of  an  or¬ 
ganization  whose  variations  and/or  inefficiencies  are  sig¬ 
nificantly  affected  by  the  given  technology  and  policies 
of  the  firm  which  are  not  random.  Magnitudes  of  actual 
outputs  of  an  organization  are  influenced  by  both  local 
and  corporate  policy  which  may  prevent  the  true  expected 
output  values  of  the  organization  from  conforming  to  the 
corresponding  regression  estimates.  Furthermore,  there 
might  be  little  or  no  correlation  between  the  relative 
magnitude  of  actual  organizational  outputs  and  the  rela¬ 
tive  magnitudes  of  their  regression  estimates,  yet  rela¬ 
tive  magnitudes  have  an  important  effect  on  the  establish- 
ment  of  frontiers  and  neighborhoods  of  comparison  in  mul¬ 
tiple  output  situations. 

If  a  linear  least  squares  regression  equation, 
with  all  of  its  assumptions,  is  accepted  as  a  proper 


representation  of  organizational  productivity,  then  accord 
ing  to  Sherman  [45]  the  "relationships  estimated  by  re¬ 
gression  techniques  reflect  (approximately)  efficient 
input-output  relationships."  The  rate  of  technical  sub¬ 
stitution  of  any  two  inputs--the  ratio  of  the  regression 
coefficients  for  those  inputs--is  assumed  constant  for  all 
organizations.  Moreover,  the  rate  at  which  an  input  is 
transformed  into  an  output  is  assumed  to  be  the  same  for 
every  organization. 

Under  these  assumptions,  the  average  output  of 
an  organization  is  not  expected  to  increase  unless  one  or 
more  of  the  inputs  increase;  and,  if  any  input  is  reduced, 
then  another  input  must  increase  or  the  expected  output 
will  be  reduced.  These  relationships  are  those  that  one 
would  expect  to  find  in  organ izations  having  efficient 
productive  capability.  In  inefficient  organizations, 
either  the  same  output  can  be  achieved  with  reduced  inputs 
or  greater  output  can  be  obtained  with  the  same  _  'sources. 

Perhaps  Sherman  used  the  term  "approximately" 
in  allowing  for  the  random  output  variability  represented 
by  the  regression  residual.  This  variability  is  assumed 
to  be  caused  by  reasonable,  efficient  adjustments  of  out¬ 
put  levels  in  response  to  random  shocks  in  production  or 


random  market  fluctuations.  However,  if  organizations  are 
operating  under  different  technologies,  the  variances  in 
outputs  caused  by  differences  in  technical  efficiency 
would  be  subsumed  by  this  residual  term.  These  variances 
are  not  random.  Two  organizations  having  precisely  the 
same  inputs  but  different  levels  of  technical  efficiency 
would  also  have  two  different  expected  output  levels,  and 
the  difference  would  be  accounted  for  in  the  residual 
term.  Least  squares  would  consider  efficient  and  ineffi¬ 
cient  organizations  simultaneously  and  the  best  fit  would 
be  influenced  by  both  types  of  behavior,  including  the 
case  where  residuals  are  forced  to  lie  below  the  frontier 
[45].  Under  such  conditions,  a  single  regression  equation 
would  misrepresent  the  productive  capability  and  effi¬ 
ciency  of  the  units. 

One  would  expect  that  removal  of  the  subsumed 
difference  in  technical  efficiency  from  the  residual  term 
would  produce  a  regression  equation  which  explains  more  of 
the  variation  in  output  (higher  R ^ )  .  Sherman  [45]  tested 
this  hypothesis  with  a  simulation;  and  Bessent,  Bessent 
and  Clark  [9]  were  able  to  support  his  findings  by  using 
DEA  to  identify  the  efficient  organizations  in  a  sample 
(n=216),  then  applying  least  squares  regressions  to  the 


efficient  units  only,  and  comparing  these  regression  re¬ 
sults  with  the  ones  obtained  when  all  units  were  consid¬ 
ered. 

The  r2  value  increased  when  only  efficient  units 
were  used  in  the  regression.  There  were  also  mode  st  gains 
in  the  significance  levels  of  regression  coefficients. 
These  improvements  were  achieved  despite  the  reduction  in 
residual  degrees  of  freedom. 

If  there  exist  an  adequate  number  of  efficient 
units  in  the  data  set,  the  above  results  suggest  that  one 
should  perform  regression  (linear  or  nonlinear)  on  only 
the  efficient  units  to  obtain  the  best  regression  equa¬ 
tion,  one  which  comes  closer  to  representing  a  frontier 
and  which  explains  a  larger  portion  of  output  variability. 

But,  it  appears  at  this  point  that  current  re¬ 
gression  analysis  techniques  are  largely  inappropriate 
when  establishing  frontiers  for  nonprofit  organizations 
which  do  not  have  highly  mechanistic,  scientifically  en¬ 
gineered  production  technologies  (see  [31]).  DEA,  on  the 
other  hand,  provides  a  useful  representation  of  an  attain¬ 
able  production  frontier,  provides  pertinent  information 
about  organizational  efficiency,  and  is  not  subject  to  the 
errors  and  misrepresentations  which  can  result  if  the 


regression  assumptions  are  violated  or  if  the  form  of  the 
production  function  is  mi s s pec i f ie d . 

Furthermore,  DEA  takes  all  outputs  and  inputs 
into  account  simultaneously  including  differences  in  input 
output  mixes  and  tradeoffs  among  factors.  It  indicates 
which  organizations  are  on  the  efficiency  frontier,  es¬ 
tablishes  a  piece-wise  linear  approximation  of  the  fron¬ 
tier  surface  using  efficient  units,  and  assigns  an  effi¬ 
ciency  measure  based  on  how  far  the  unit  is  from  a  fron¬ 
tier  point  directly  between  the  unit  and  the  origin,  a 
point  for  which  input  and  output  values  are  linear  combi¬ 
nations  of  the  observations  from  an  efficient  set  of 
"neighborhood"  organizations.  Evaluations  of  frontier 
points,  neighborhoods,  and  efficiency  measures  for  indi¬ 
vidual  units  are  all  readily  accessible  through  DEA  but 
are  hidden  from  explicit  examination  in  the  regression 
analysi s . 

A  it hough  DEA  appears  to  be  the  best  alternative 
for  analysis  in  the  public  sector,  further  research  is 
needed  to  determine  how  the  models  of  DEA  and  statistical 
econometrics  can  be  used  in  conjunction  with  one  another 
to  improve  frontier  estimation  and  analysis.  It  is  likely 
that  a  more  thorough  frontier  analysis  will  be  achieved 
by  the  use  of  a  number  of  different  but  related  models. 


Ratio  Analysis 

Ratio  Analysis  is  not  a  method  of  frontier  esti¬ 
mation,  but  it  is  relevant  to  this  discussion  because  of 
its  frequent  use  as  an  ex  post  facto  evaluation  tool  in 
analyzing  multiple  input,  multiple  output  relations. 

Users  of  this  method  examine  multiple  measures  in  the  form 
of  ratios  in  an  attempt  to  compare  the  performance  of 
similar  organizations;  each  ratio  typically  being  a  single 
output  measure  divided  by  a  single  input  measure  [36]  and 
[45].  Like  DEA,  ratio  analysis  is  used  when  the  produc¬ 
tion  process  is  unknown  or  difficult  to  model. 

Unlike  DEA,  ratio  analyses  do  not  make  use  of 
mathematical  models  to  organize  or  assimilate  ratios  into 
a  single  aggregate  measure  of  efficiency;  i.e.,  they  do 
not  simultaneously  take  into  account  interactions  over  the 
full  range  of  inputs  and  outputs  [45].  As  a  result,  the 
performances  of  organizations  are  difficult  to  compare 
using  this  method  particularly  when  organizations  rank 
comparatively  high  on  some  measures  and  low  on  others 
[36]  . 

This  difficulty  can  be  illustrated  by  the  follow 
ing  simple  example.  Consider  the  two  organizations  in 


able  2.1. 


Table  2.1 
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Difficulties  in  Using  Ratios  to  Compare  Performance 

Organizational  Units 
A  B 


Output 

1 

1 

Input  1 

1 

2 . 5 

Input  2 

4 

2 . 5 

Ratio  1 

(=0ut put/input 

1) 

1 

0.4 

Ratio  2 

( =0ut  put /input 

2) 

.25 

0.4 

Note,  Ratio  1  of  organization  A  is  larger  than  Ratio  1  of 
B,  and  the  situation  is  reversed  for  Ratio  2.  The  rela¬ 
tive  performance  of  organizat ion s  A  and  B  cannot  be  de¬ 
termined  by  examination  of  these  ratios  unless  the  rela¬ 
tive  importance  (weight)  of  each  ratio  is  specified. 
Furthermore,  as  the  number  of  inputs  and  outputs  increases 
the  problems  of  weighting  and  assimilation  grow  multipli¬ 
cative  ly . 

Lewin,  Morey,  and  Cook  [36]  examined  this  prob¬ 
lem  in  an  evaluation  of  judicial  districts.  They  ranked 
each  of  ten  output- to- input  ratios  (2  outputs  x  5  inputs) 
and  displayed  the  number  of  times  that  districts  were 
ranked  in  the  upper  and  lower  quartiles  over  the  ten  ratio 


measures.  Several  districts  were  noted  to  have  ratios  in 


both  quartiles.  Under  these  circumstances,  it  would  be 
very  difficult  to  find  a  simple  rule  to  distinguish  ef¬ 
ficient  districts  from  inefficient  ones  without  making 
subjective  judgments  about  the  relative  importance  of 
each  ratio. 

Another  related  difficulty  stems  from  the  fact 
that  single  ratios  provide  only  partial,  incomplete  mea¬ 
sures  of  multiple  input-output  relations,  a  condition 
which  often  leads  to  incorrect  judgments  of  performance. 
In  actual  practice,  partial  measures  such  as  "units  pro¬ 
duced  per  manhour"  are  used  as  measures  of  performance 
without  regard  to  other  inputs  such  as  supplies,  fuel, 
equipment,  etc.  The  data  in  Table  1  can  be  used  to  illus¬ 
trate  the  risk  in  this  practice.  If  one  were  to  compare 
units  A  and  B  based  on  Ratio  1  alone,  unit  B  would  appear 
to  be  a  better  performer  than  A  ( .4  >  .25),  but  the  re¬ 
verse  would  be  true  if  Ratio  2  were  considered  alone. 

Sherman  [45]  and  Bessent,  Bessent  and  Clark  [8] 
used  DEA  as  a  vehicle  for  examining  the  risks  of  partial 
measurements.  Each  experiment  used  a  set  of  hypothetical 
organizations  whose  inefficiencies  were  known  and  detect¬ 
able  by  DEA.  DEA  efficiency  evaluations  were  performed  on 
the  sets  with  all  inputs  and  outputs  included.  Other 


evaluations  were  performed  with  one  input  or  output  omit¬ 
ted.  The  results  indicated  that  partial  measures  can 
cause  mi sclassif ications  of  efficiency;  i.e.,  organiza¬ 
tions  might  be  incorrectly  labeled  efficient  or  ineffi¬ 
cient.,  or  the  magnitudes  and  causes  of  the  inefficiencies 
might  be  misspecif ied.  In  general,  the  omission  of  rele¬ 
vant  inputs  or  outputs  during  frontier  evaluations  may 
cause  distorted  neighborhoods  of  comparison,  erroneous 
slack  conditions  or  measurements  relative  to  the  wrong 
frontier  facet. 

Despite  the  above  shortcomings,  ratios  do  have 
the  advantage  of  being  familiar  to  managers  and  simple  to 
understand  [45].  But  this  advantage  is  outweighed  by  the 
risk  of  obtaining  misleading  results  unless  ratio  analysis 
is  used  in  conjunction  with  methods  of  frontier  estimation 
like  DEA  which  are  able  to  take  all  inputs  and  outputs 
into  account  simultaneously. 

Summary  of  DEA  Theory  and  Review 
of  DEA  Applications 

Introduction 

In  the  present  section,  published  sources  as  well 
as  available  unpublished  papers  will  be  reviewed  with  the 


intent  of  documenting  the  state-of-the-art  in  DEA  theory 
and  application.  Precursors  of  DEA  were  discussed  in  an 
earlier  section  so  that  attention  will  be  directed  here  to 
those  studies  in  which  the  Data  Envelopment  Analysis  tech¬ 
nique  of  Charnes,  Cooper,  and  Rhodes  has  been  employed. 

The  review  includes  both  the  development  of  the 
theory  and  fields  of  its  reported  application.  Unsettled 
questions  and  issues  will  be  cited  where  appropriate. 
First,  sources  which  specified  the  basic  theory  are  re¬ 
viewed,  then  first  level  applications  are  cited--those 
that  employ  DEA  primarily  to  identify  efficient  and  inef¬ 
ficient  management  units.  Finally,  applications  which  ex¬ 
tend  DEA  are  reported.  These  extensions  are  limited  at 
present  but  they  concern  management  uses  beyond  simply  lo¬ 
cating  inefficient  units  and  point  toward  reallocating  re¬ 
sources,  setting  output  goals,  planning  to  achieve  objec¬ 
tives  through  more  efficient  operations,  and  finally,  in¬ 
corporation  of  DEA  into  management  decision  support  sys¬ 
tems. 

The  major  sources  reviewed  are  displayed  in  Ta¬ 
ble  2.1  along  with  their  primary  purposes  and  field  of 


applicat i on . 


PEA  Theory  and  Mathematical 
Programming;  Models 

The  conceptualization  of  PEA  and  formulation  of 
the  associated  mathematical  programming  models  first  ap¬ 
peared  in  1978  when  Charnes  and  Cooper  and  Rhodes'  "Measur 
ing  the  Efficiency  of  Pecision  Making  Units"  [IS]  was  pub¬ 
lished  in  the  European  Journal  of  Operational  Research , 
Relating  their  work  to  isoquant  analysis  and  Farrell  ef¬ 
ficiency,  Charnes,  Cooper  and  Rhodes  defined  the  ratio 
models  for  multiple  outputs  and  inputs  and  reduced  the 
model  to  its  linear  programming  forms. 

In  a  parallel  effort,  Charnes  and  Cooper,  and 
Rhodes  employed  PEA  to  make  a  secondary  analysis  of  data 
from  a  large  scale  social  experiment  in  public  education 
known  as  Program  Follow  Through.  This  work  was  referred 
to  in  several  publications  by  Charnes  and  Cooper  [14], 

[15],  [16],  but  received  its  most  complete  documentation 

in  Rhodes  [43]  and  Charnes,  Cooper  and  Rhodes  [18]. 

The  evaluation  of  the  Follow  Through  experiment 
was  noteworthy  in  that  separate  efficiency  frontiers  were 
determined  for  Follow  Through  and  Non-Follow  Through 
schools.  This  made  possible  the  adjustment  of  inefficient 


units  to  their  respective  frontiers  with  the  result  that 


program  efficiencies  could  be  compared  after  removal  of 
what  was  termed  managerial  inefficiency  of  individual 
units. 

Called  "inter-envelope"  analysis  by  Charnes, 
Cooper,  and  Rhodes,  this  method  of  evaluation  has  not  been 
reported  by  subsequent  researchers  although  it  would  seem 
to  have  considerable  promise  for  evaluation.  One  of  the 
unresolved  difficulties  of  this  application  was  the  ab¬ 
sence  of  an  appropriate  statistic  for  comparing  the  effi¬ 
ciency  envelopes  of  the  contrasted  programs.  One  approach 
to  the  problem  was  suggested  by  Charnes  and  Cooper  who 
considered  the  use  of  a  "divergence  statistic"  proposed  by 
Kulback  [16]. 

Another  problem  discovered  in  early  work  with 
DEA  was  the  possibility  of  having  an  efficient  unit  with 
nonzero  slack  values.  This  difficulty  was  overcome  by 
means  of  an  efficiency  theorem  reported  by  Charnes,  Cooper 
Lewin,  Morey  and  Rousseau  [17].  This  modification  intro¬ 
duced  an  infinitesimal  value  (called  a  n on- Arch ime dean 
element)  to  the  objective  function  as  shown  earlier  in 
this  study. 

In  the  same  paper,  Charnes,  et  al.  [17]  consid¬ 
ered  another  intractable  problem  in  the  managerial 


interpretation  of  DEA  re  suit s- - that  of  n on di s c r e t i ona ry 
resources.  That  is,  some  inputs  to  a  DEA  application  may 
include  exogenous  factors  beyond  the  manager's  control 
which  nonetheless  affect  production  of  outputs.  The  pro¬ 
posed  solution  to  the  problem  was  to  adjust  the  observa¬ 
tions  for  inefficient  units  by  augmenting  outputs  accord¬ 
ing  to  the  first  DEA  model  solution  and  by  similarly  de¬ 
creasing  only  those  discretionary  inputs  which  have  con¬ 
trollable  slack,  A  subsequent  DEA  solution  with  these  ad¬ 
justed  values  gives  a  new  efficiency  rating  after  allowing 
for  nondiscretionary  inputs.  Note  that  when  all  inputs 
are  discretionary,  then  all  units-  are  efficient  after  the 
adjustment . 

An  extension  of  DEA  was  recently  proposed  by 
Banker,  Charnes,  Cooper  and  Schinnar  [4]  in  which  piece- 
wise  0-linear  (includes  Cobb-Douglas  and  log- linear  forms) 
production  functions  are  assumed;  the  problem  then  becomes 
one  of  estimating  parameters  of  the  production  functions 
by  means  of  DEA  "envelopment  conditions"  where  production 
function  forms  are  imposed  on  outputs  and  ordinary  linear 
programming  equivalents  are  given.  The  development  takes 
into  account  possible  economies  or  diseconomies  of  scale 
for  the  multiple  output  case.  Although  a  numerical  ex¬ 
ample  was  given,  no  applications  have  been  reported. 


Validation  of  Data  Envelopment 
Analyst  s 

Lewin  and  Morey  [35]  showed  that  DEA  measured 
efficiency  consistent  with  regression  results  and  known 
validity,  but  the  only  extensive  validation  of  DEA  which 
has  been  reported  was  Sherman's  study  of  efficiency  of  22 
hospital  me di ca 1- sur g i ca 1  units  [45].  Three  different 
evaluations  were  made:  (l)  a  comparison  of  DEA  with  ratio 
analysis  and  statistical  regression,  (2)  the  use  of  a  panel 
of  health  care  experts,  and  (3)  review  by  staff  of  a  hos¬ 
pital  which  received  an  inefficient  rating. 

In  Sherman's  first  validity  evaluation,  a  simu¬ 
lation  was  employed  using  hypothetical  organizations  hav¬ 
ing  known  inefficiencies  and  technologies.  It  was  found 
that  DEA  detected  the  known  inefficiencies  and  provided 
more  managerial  information  than  the  partial  measures 
given  by  ratio  analysis.  Unlike  DEA,  regression  models 
produced  best  fit  results  which  confounded  observed  in¬ 
efficiencies  and  efficiencies. 

Results  of  DEA  were  compared  to  judgments  of 
four  hospital  administrators  who  gave  qualified  agreement 
on  7  out  of  10  hospital  inefficiency  ratings  and  strong 
disagreement  about  one  case.  The  strong  disagreement  was 


later  resolved  by  in-depth  study.  However,  the  experts 
continued  to  believe  that  some  hospitals  rated  efficient 
were  really  inefficient  and  that,  in  general,  they  pre¬ 
ferred  simpler  modes  of  analysis  to  DEA . 

Finally,  a  field  study  of  one  inefficient  hos¬ 
pital  was  conducted  in  which  hospital  management  verified 
the  data  and  related  the  actual  operations  of  the  medical- 
surgical  unit  to  DEA  results.  Inefficiencies  detected  by 
DEA  included  slack  inputs  for  supplies,  beds  and  staff  all 
of  which  were  verified  by  the  hospital  administrators  and 
it  was  concluded  that  the  inefficiency  rating  was  valid 
and  that  the  sources  of  inefficiency  were  identifiable. 

DEA  Application  in 
V  arious .Fie  Ids 

Most  of  the  reported  applications  of  DEA  have 
been  for  the  purpose  of  demonstrating  that  efficient  and 
inefficient  management  units  can  be  identified  by  means  of 
the  technique  and  that  inputs  and  outputs  can  be  defined 
which  have  meaning  for  management  audit  and  review.  These 
can  be  called  "applications  of  the  first  level"  to  dis¬ 


tinguish  them  from  management  planning  and  reallocation 


In  the  present  section;  first  level  applications 
in  health  care,  education,  military,  and  court  systems  are 
reported.  The  singular  use  of  DEA  by  Charnes,  Cooper  and 
Rhodes  [18]  for  program  evaluation  was  reviewed  in  the 
previous  section. 

Health  Care  Application.  Sherman's  study  [45] 
is  the  only  application  reported  in  the  health  care  field. 
Teaching  medical- surgica 1  units  in  22  Massachusetts  hos¬ 
pitals  were  chosen  for  the  purpose  of  comparing  DEA  mea¬ 
surement  of  technical  efficiency  with  other  methods. 
Available  data  from  an  annual  report  submitted  to  the 
State  Rate  Setting  Commission  were  used  to  select  three 
inputs  and  four  outputs  for  the  analysis.  The  outputs 
represented  both  patient  care  and  training  functions  of 
the  hospitals,  thus  providing  greater  complexity  than 
would  be  the  case  if  only  nonteaching  hospitals  were  in¬ 
cluded.  Surgical  units  were  selected,  rather  than  the 
hospital  as  a  whole  or  other  subunits  such  as  radiology, 
in  order  to  decrease  the  variability  in  case  mix. 

As  reported  earlier,  the  hospital  application 
demonstrated  that  DEA  is  potentially  useful  for  measure¬ 
ment  of  the  relative  technical  efficiency  of  hospital  sub¬ 
units.  As  might  be  expected,  however,  the  most  serious 


limitation  concerned,  the  specification  and  measurement  of 
inputs  and  outputs  since  the  ones  in  actual  use  in  hos¬ 
pitals  are  not  typically  in  forms  which  are  sufficiently 
accurate  for  DEA  use.  In  addition,  the  application  was 
limited  to  only  one  type  of  subunit  in  the  complex  organi¬ 
zation  of  a  comprehensive  hospital.  More  extensive  use¬ 
fulness  remains  to  be  demonstrated. 

Application  in  Public  Education.  Two  similar 
applications  of  DEA  in  large  urban  school  districts  were 
reported  by  Bessent  and  Bessent  [6]  and  Bessent,  Bessent, 
Kennington  and  Reagan  [10]. 

In  the  first  of  these,  55  elementary  schools 
comprised  the  units  of  analysis  with  standardized  achieve¬ 
ment  test  scores  providing  two  measures  of  output.  Thir¬ 
teen  inputs  were  chosen  as  proxy  measures  of  attendance, 
socioeconomic  status  and  mobility,  resources  allocated  to 
the  schools  and  indicators  of  organizational  climate  within 
schools . 

The  second  application  in  a  different  city  stud¬ 
ied  both  elementary  and  secondary  schools  but  results  for 
only  167  elementary  schools  were  reported.  The  purpose  of 
the  second  study  was  to  investigate  the  use  of  DEA  to  pro¬ 


vide  a  better  comparative  analysis  of  academic  performance 


than  was  previously  available  to  the  administration  and 
Board  of  Education. 

Data  employed  by  the  district  for  their  school 
comparisons  provided  input  and  output  variables  for  DEA: 
reading  and  mathematics  achievement  test  scores  for  third 
and  sixth  grade  (4  outputs),  resources  allocated  (seven 
i n  put  s)  and  five  nonallocatable  inputs  re  dating  to  stu¬ 
dents'  characteristics  and  prior  years'  achievement.  In 
addition  to  the  usual  reports  of  efficiency  and  slack,  re¬ 
sults  were  displayed  by  plotting  achievement  against  ef¬ 
ficiency.  This  provided  information  about  both  effective¬ 
ness  and  efficiency  of  schools. 

Results  of  the  Houston  study  were  seen  as  useful 
not  only  for  management  audit  but  also  for  system  scanning 
information  to  use  for  balancing  scarce  resources  among 
schools.  The  latter  use  was  not  pursued  in  the  study  how¬ 
ever,  since  DEA  models  for  reallocation  decisions  did  not 
exist  at  that  time. 

As  in  the  Sherman  study  [45],  limitations  en¬ 
countered  were  inadequate  specification  of  outputs  and  in¬ 
puts,  and  difficulties  in  communicating  DEA  methods  and 
results  to  users.  However,  some  progress  in  reducing  these 
difficulties  through  the  formation  of  a  network,  of  school 


districts  was  reported.  Personnel  of  member  schools  pro¬ 
vided  better  input  and  output  measures  and  attended  train¬ 
ing  sessions  on  the  use  of  DEA  results  for  improved  plan¬ 
ning.  Since  the  study,  three  years  of  successful  operation 
of  the  network  have  been  achieved. 

DEA  Applications  in  the  Military.  No  military 
applications  of  DEA  have  been  reported  in  the  periodical 
literature  although  some  work,  for  the  U.S.  Army  by  Charnes, 
Cooper,  Devine,  Klopp,  and  Stutz  [  ]  is  in  progress  and 

Navy  recruiting  districts  have  been  studied  by  Lewin  and 
Morey  [35]. 

The  military  recruitment  studies  were  similar 
in  purpose  to  those  already  discussed  in  that  they  sought 
to  measure  the  efficiency  of  recruiting  centers  and  to 
provide  information  for  superordinate  review  of  sources  of 
inefficiency.  They  differed,  however,  in  that  time  series 
data  were  employed  for  the  analysis.  The  study  in  pro¬ 
gress  by  Charnes,  et  al.  [  ]  used  quarterly  data  to  pro¬ 

vide  a  series  for  each  unit  in  the  analysis.  Lewin  and 
Morey  [35]  used  monthly  data  to  compare  the  efficiency  of 
a  single  recruiting  district  with  itself  at  different  time 
periods.  As  might  be  supposed,  a  significant  seasonal  ef¬ 
fect  was  observed  for  recruiting. 


The  inclusion  of  a  time  series  of  measurements 


is  an  important  extension  since  any  serious  management 
employment  of  DEA  would  result  in  repeated  measures  over 
time.  Procedures  have  not  been  reported,  however,  for 
using  time  series  information  for  more  than  repeated  snap¬ 
shots. 

Potential  use  of  DEA  for  management  of  Air  Force 
maintenance  squadrons  was  discussed  by  Clark  [22].  This 
application  envisioned  DEA  as  a  component  in  a  decision 
support  system.  It  will  be  discussed  later  along  with 
other  extensions  of  DEA. 

The  Measurement  of  Efficient  Operation  of  Courts 
Lewin,  Morey  and  Cook  [36]  employed  DEA  to  evaluate  the 
administrative  efficiency  of  100  superior  courts  in  30 
North  Carolina  judicial  districts.  They  employed  log- log 
stepwise  regression  of  variables  from  archival  data  to 
select  five  inputs  and  two  outputs  for  DEA  computations. 
Taking  the  perspective  of  the  court  administrator,  DEA  was 
shown  to  be  superior  to  ratio  analysis  in  that  it  provided 
a  single  efficiency  rating  and  required  no  subjective  ap¬ 
praisal  of  multiple  performance  ratios.  In  addition,  DEA 
was  viewed  as  useful  as  a  diagnostic  tool  when  used  in 
combination  with  field  audits. 


Identifying  inefficient  units  is  only  a  prelude 
to  the  desire  to  remove  sources  of  inefficiency.  For  the 
manager  of  a  unit  who  seeks  to  make  more  effective  use  of 
resources,  DEA  provides  descriptive  information  for  needed 
output  augmentation  and/or  resource  conservation.  Two  re¬ 
ported  applications  of  DEA  for  planning  and  managerial 
decision  making  will  now  be  considered. 

The  first  was  a  study  reported  by  Bessent,  Bes- 
sent,  Charnes,  Cooper,  and  Thorogood  [7]  which  resulted  in 
actual  management  decisions.  It  concerned  the  evaluation 
of  proposed  program  modifications  in  the  occupational- 
technical  division  of  a  college. 

The  problem  addressed  was  to  determine  the  ef¬ 
fect  on  efficiency  of  existing  programs  contingent  upon 
various  changes  proposed  by  subordinate  program  heads: 
augmenting  new  technologies  in  an  existing  program,  intro¬ 
ducing  a  new  competing  program,,  or  abolishing  an  ineffi¬ 
cient  program  and  redistributing  its  resources. 

Three  outputs  and  four  inputs  were  selected  from 
data  used  for  budgeting  and  planning  for  22  different  pro¬ 
grams  under  the  direction  of  the  division  administrator. 
DEA  solutions  were  first  obtained  for  the  existing 


programs  and  inefficient  units  were  identified.  Their 
planning  alternatives  were  identified  on  the  basis  of  con¬ 
sumer  demand,  employment  trends  and  allocatable  space. 

One  proposal  evaluated  was  to  augment  the  Busi¬ 
ness  Technology  program  by  adding  legal  secretarial  train¬ 
ing.  The  Director  evaluated  a  plan  for  rescheduling  clas¬ 
ses  and  faculty  to  better  utilize  resources.  With  these 
changes  and  with  meeting  projected  contact  hour  goals,  a 
new  DEA  evaluation  resulted  in  an  improved  efficiency 
rating.  On  the  basis  of  these  findings,  a  decision  was 
made  to  expand  the  program. 

A  similar  change  was  evaluated  in  which  an  al¬ 
ready  efficient  program  was  augmented.  A  subsequent  DEA 
analysis  showed  that  such  augmentation  would  change  the 
efficiency  frontier  causing  a  reduction  in  the  comparative 
efficiency  rating  of  some  other  units.  The  Director  de¬ 
cided  to  implement  this  change  in  order  to  provide  a  highe 
motivation  for  existing  subprogram  heads  with  the  result 
that  overall  productivity  would  increase. 

A  third  change  was  based  on  DEA  evaluation  of 
proposals  for  three  new  cost  centers.  Following  this 
analysis,  the  Director  decided  against  one  because  it  was 
less  efficient  than  existing  programs.  The  other  two  had 
favorable  recommendations . 
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Finally,  two  existing  programs  which  had  effi¬ 
ciency  ratings  of  less  than  .53  were  candidates  for  dis¬ 
continuation.  Both  were  older  programs  for  which  the  job 
market  had  declined.  Three  alternatives  were  evaluated 
by  using  DEA  to  determine  the  impact  of  phasing  out  the 
inefficient  programs  and  redistributing  allocatable  re¬ 
sources  to  other  programs. 

The  use  of  DEA  for  evaluating  proposed  program 
changes  was  found  to  be  feasible  but  was  limited  by  the 
absence  of  an  overall  planning  model. 

The  feasibility  of  designing  a  decision  support 
system  based  upon  DEA  was  examined  by  Clark  [22]  in  an 
analysis  of  management  systems  for  maintaining  Air  Force 
readiness.  A  semi  structure d  decision  support  system  was 
seen  as  a  way  to  improve  the  quality  of  decisions  througn 
a  more  systematic  decision  process  and  increased  manage¬ 
rial  understanding  and  control  of  operations. 

Clark  proposed  the  rudimentary  decision  steps 
shown  in  Figure  2.3.  It  begins  with  DEA  efficiency  rat¬ 
ings,  progresses  to  use  of  other  information  obtained  from 
the  linear  programming  solutions,  and  finally  evaluates 


decision  alternatives. 


According  to  Clark,  managers  may  monitor  and  con 
trol  the  efficiency  of  their  organizational  units  by  means 
of  these  steps  which  correspond  to  the  following  set  of 
management  questions. 

a.  Is  the  unit  efficient  when  compared  to  others 
having  similar  missions  and  technologies? 

b.  If  the  unit  is  rated  inefficient,  which  variables 
are  responsible  for  the  low  rating?  Are  there 
excesses  in  inputs,  shortfalls  in  outputs,  or 
combinations  of  both? 

c.  If  rated  efficient,  and  if  an  increase  in  outputs 
is  desirable,  which  inputs  can  be  increased  to 
achieve  greater  output? 

d.  To  what  extent  are  the  desired  changes  in  vari¬ 
ables  controllable  by  management?  For  example, 
weather  and  ether  external  causes  which  might  re¬ 
duce  efficiency  are  not  controllable. 

e.  If  variables  are  completely  or  partially  control¬ 
lable,  which  responsibility  centers  must  be  in¬ 
volved  in  taking  the  appropriate  corrective  ac¬ 
tions? 

f.  Whao  actions  are  appropriate?  Some  problems  are 
caused  by  operational  or  resource  deficiencies 


ao 

which  are  strictly  within  the  management  control 
of  the  unit  itself.  Others  are  caused  by  inade¬ 
quate  support  from  other  agencies  upon  which  the 
unit  must  rely.  Is  the  indicated  action  to:  (l) 

improve  the  use  of  existing  resources  (manpower, 
equipment,  supplies,  facilities,  information), 

(2)  acquire  additional  resources,  (3)  allocate/ 
reallocate  resources  (budgets),  or  (4)  improve 
production  methods  (plans,  schedules,  reorganiza¬ 
tions,  policies,  procedures,  etc.)? 

g.  Have  the  management  actions  resulted  in  the  de¬ 
sired  efficiency  changes?  A  follow-up  efficiency 
evaluation  would  be  useful  after  corrective  ac¬ 
tions  have  had  suf  :ient  time  to  take  effect. 
This  evaluation  should  compare  the  unit's  effi¬ 
ciency  to  the  original  comparison  set  (paragraph 

1  above ) . 

h.  Is  the  unit  efficient  when  compared  to  current 
data  from  other  units  in  the  comparison  set? 

This  would  measure  progress  made  versus  that 
achieved  by  others,  and  if  begins  the  cycle 
again. 


Implementation  of  the  DEA-based  decision  support 
system  would  require  additional  mathematical  models,  would 


be  enhanced  by  an  interactive  modeling  language  and  would 
depend  upon  the  development  of  more  precise  logic  for  re¬ 
lating  managerial  inquiries  to  the  results  of  an  effi¬ 
ciency  analysis.  The  extensions  presented  in  the  next 
chapter  are  crucial  parts  of  this  development.  DEA-based 
management  planning  for  removal  of  inefficiencies  and  for 
allocations  to  improve  effectiveness  are  not  possible  un¬ 
less  one  is  able  to  specify  target  frontier  regions  or 
facets  of  efficiency  for  each  unit  and  determine  the  rates 
of  substitution  within  these  facets. 
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THEORETICAL  EXTENSIONS 


Int r od  uct ion 

In  this  chapter,  theoretical  extensions  are 
presented  to  overcome  the  aforementioned  difficulties  in 
DEA  resulting  from  use  of  non -Ar ch imed e an  infinitesimals 
(€  values).  The  solution  of  the  Charnes,  Cooper  and 
Rhodes  DEA  problem  will  provide  information  for  use  in 
performing  second  stage  evaluations  to  locate  the  near¬ 
est  empirical  facet  of  each  inefficient  unit  and,  if 
necessary,  to  extend  frontier  neighborhoods  in  an  at¬ 
tempt  to  achiev.e  full  envelopment  (no  slack)  of  all  such 
units.  Units  identified  by  DEA  as  having  slack  in  inputs 
or  outputs  will  receive  a  new  efficiency  measure  which 
essentially  provides  a  lower  bound  of  efficiency.  Each 
of  these  new  efficiency  values  will  be  measured  relative 
to  an  extended  frontier  point  which  is  a  linear  combina¬ 
tion  of  the  actual  input  and  output  observations  of  ef¬ 
ficient  units,  and,  if  possible  no  slack  variables  will 
be  permitted  in  the  optimal  basis. 


Furthermore,  extended  frontier  points  will  pro¬ 
vide  alternative  estimates  of  input  and  output  "values  if 


efficient”  for  comparison  with  those  provided  by  DEA. 

In  computing  these  values  for  an  inefficient  unit,  one  ca 
either  hold  the  unit's  output  vector  of  observations  con¬ 
stant  and  multiply  its  input  values  by  the  efficiency 
measure,  or  hold  its  input  vector  constant  and  multiply 
outputs  by  the  reciprocal  of  the  efficiency  measure.  Eve 
when  such  input  and  output  projections  are  not  deemed 
technically  feasible  (or  achievable)  by  managers,  the 
second  stage  evaluation,  which  reveals  a  complete  basis 
of  efficient  units  in  a  nearby  facet,  can  be  used  in  con¬ 
junction  with  DEA  in  developing  more  realistic  planning 
e  st imate  s . 

Each  of  the  above  characteristics  are  presented 
below  in  greater  detail.  But  before  proceeding  with  the 
necessary  definitions,  properties  and  proofs  related  to 
the  second  stage  model,  the  primal  and  dual  formulations 
of  the  DEA  model  will  be  recalled.  A  familiar  notational 
form  has  been  used  (see  [6]  [19]),  and  the  models  have 

been  numbered  so  that  they  can  be  referred  to  easily  in 
subsequent  paragraphs.  Recall  that: 

Xj_j  =  the  amount  of  input  type  i  used  by  DMU  j  dur¬ 
ing  the  period  of  observation,  i  =  1,2, ...,m 


the  amount  of  output  type  r  produced  by  DMU  j 


during  the  period  of  observation,  r  = 
and  j  =  1,2,  .  .  .  ,  n 

=  the  amount  of  input  type  i  used  by  the  unit  k 
where  k  c  J  =  (1,2,  ...,n}  and  unit  k  is  the  DMU 
being  evaluated.  Each  DMU  in  turn  will  be 
e  va luat  ed . 

yrk  =  the  amount  of  output  type  r  used  by  DMU^ 
hj^  =  the  efficiency  value  sought  for  DMU^ 
vik  =  the  multipliers  for  each  input  type  i  which 
will  be  determined  by  solution  of  the  model 
for  unit  k 

urk  =  the  multipliers  for  each  out  put  type  r  which 
will  be  determined  by  solution  of  the  model 
for  unit  k 

As  indicated  in  Chapter  I,  the  following  model 
formulations  are  used  to  determine  h^,  the  efficiency 
rating  of  any  specified  DMU^,  from  among  the  j  =1,2,..., 
k,  . .  .n  units  : 

Primal: 


k 


Max  h 


s 

.Z 


ur k^r  k 


(3.1) 


where  e  >  0  is  a  non-Ar chimedean  infinitesimal  quantity 


Dua  1 : 
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r  1 ,  2,  .  .  . , s 
n 

Xjxij  +  9kxik  -  3 ik  =  0 

3  =1 

i  =  1,  2  ,  .  .  .  ,m 


Xj  >  0  for  all  j ; 


srk>  sIk  >  0 


unrestricted 


Da  f init ions 


Two  definitions  and  a  definitional  property  are 
no-w  presented  to  clarify  the  meaning  of  the  terms  "proper 
facet"  and  "fully  enveloped,"  terms  which  are  used  fre¬ 
quently  in  subsequent  developments. 

De  f init ion .  The  frontier  facet  defined  by  em¬ 
pirically  observed  basis  units  is  called  a  proper  facet 
if  it  is  formed  by  j  =  1,  2,  .  .  ,,s+m-l  efficient  units  (ac¬ 
tual  units  from  original  comparison  set)  and  if  there 
exist  column  vectors  >  0  and  f  >  0  such  that 


/  Y1 


(3.3  ) 


for  every  efficient  unit  j  in  the  optimal  basis  of  some 
inefficient  unit  k  where 


*  (yij»y2j >  •  •  •  >ys j ) 


=  ^xlj  ,x2j  *  '  *  *  *  xm  j  ^ 


The  hyperplanes 


I  (Xj  )  =  [XT  =  (Xl,x2,  ...,xm)kTX  =  $TXj  >  0}  (3.4) 

for  basis  units  j  =  1,  2,  .  .  . ,  s  +m- 1  are  called  the  input 
hyperplanes  defined  by  the  efficient  facet.  Similarly, 

o(Yj)  =  {Yt  =  (yL,y2,  .  .  .,ys  )  |^ty  =  *Yj  }  (3.5) 

for  j  =  1, s  +m 

is  the  efficient  facet's  family  of  output  hyperplanes.  • 

If  we  define  the  constant  Cj  5  <t>TXj  = 
for  each  j  in  the  basis,  the  input  and  output  hyperplanes 
of  basis  unit  j  can  be  rewritten: 


01X1  =  Cj  '  02X2 


*iyi  =  cj  -  ^ zJ ; 


Since  0  j_  >0,  i  =  1,2, 


03X3  -  **•  •  V? 
^3y3  -  ...  -  ’^qYq 

.  ,  m  and  >0,  r 


-  0  x 
m  m 


(3.6) 
‘  '^s 


1,  2,  .  .  . , s  in 


a  proper  facet,  we  have 


ini 


try 


Z  -  L  \|r  y 

=1  *  *  q^r  q  q 


dyr 
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0i 

*r 


>  0 


(3.13) 


for  i  =  1,2, ...,m  and  r  =  1,2, ...,s.  In  other  words,  in 
order  for  an  efficient  unit  to  remain  on  the  frontier, 
incremental  increases  (decreases)  in  the  inputs  must 
produce  corresponding  increases  (decreases)  in  the  out¬ 
put  levels  achieved. 

In  actual  practice,  empirically  derived  rela¬ 
tive  frontiers  of  efficiency  might  not  exhibit  all  of  the 
above  characteristics  of  a  proper  facet.  Empirically 
formed,  relative  frontiers  of  efficiency  represent  what 
actually  happened  and  not  what  should  have  happened.  As 
a  result,  such  relative  frontiers  may  fall  short  of  the 
theoretical  ideal  and  fail  to  conform  to  what  one  would 
expect  from  an  absolute  frontier  with  its  positive  mar¬ 
ginal  productivities  and  negative  rates  of  substitution. 

It  is  important  to  detect  when  such  failures 
occur  and  why.  Perhaps  positively  correlated,  nonsub- 
stitutable  input  measures  were  selected  for  use  in  the 
DEA  model,  a  situation  which  could  lead  to  positive  rates 


of  substitution.  Or  perhaps  an  input  was  chosen  at  the 


outset  of  the  analysis  based  on  the  assumption  that  an 
increase  in  its  amount  s  hou  Id  produce  a  corresponding  in¬ 
crease  in  one  or  more  of  the  outputs  without  knowing 
whether  it  will  or  not  in  all  frontier  regions.  In  this 
case,  subsequent  frontier  evaluation  might  reveal  that  ir 
one  or  more  facets  this  input  exhibits  negative  correla¬ 
tion  with  the  outputs,  thus  failing  to  conform  to  the  re¬ 
quirement  of  having  positive  marginal  productivities  in 
pro  per  f acet  s  . 

This  situation  actually  occurred  in  the  1980- 
1981  DEA  evaluation  of  Texas  Schools  performed  by  the 
Educational  Productivity  Council.  One  input,  the  percent 
of  teachers  having  more  than  three  years  experience,  was 
shown  to  be  negatively  correlated  with  the  output  mea¬ 
sures  of  reading,  writing  and  math  in  at  least  one  fron¬ 
tier  neighborhood,  an  undesirable  situation  because  ex¬ 
perienced  teachers  as  a  rule  are  paid  more  than  their 
less  experienced  colleagues  since  educators  believe  that 
increased  experience  should  lead  to  better  teaching 
met  hod  s  . 

The  above  violations  of  the  characteristics  of 
a  proper  facet  will  cause  zero  or  negative  multipliers 
in  the  second  stage  evaluation  to  be  discussed  later.  Bu 


stage  methodology,  th 
DSA  condition  of  being  fully  enveloped  and  its  relation¬ 


ship  to  the  existen; 


proper  facet  need  to  be  d< 


fined  and  clarified. 


Definition.  An  inefficient  unit  k  is  in  the 
cone''  or  "fully  enveloped"  if  DEA  yields  an  optimal  solu¬ 
tion  to  (3.2)  having  all  sl^  and  slack  variables^ 

nonbasic  and  equal  to  zero  i.e.  each  basic  variable  in 
^3.2)  is  a  which  corresponds  to  actual  vectors  of  ob- 
served  inputs  and  outputs  for  some  frontier  unit  j. 

If  unit  k  is  totally  en' eloped,  the  requirement 
that  all  slack  variables  be  n^..oasic  means  there  are 
s+m-l  actual  unit.,  which  define  the  inefficient  unit  k's 
neighborhood  frontier  facet.  Further,  the  X's  associated 
with  these  units  form  unit  k's  optimal  basis.  let  the 
s+rn-l  elements  of  J*  =  (J  |X-s  is  in  the  optimal  basis  of 
unit  k}.  Furthermore,  let 


vf  =  (n*’  vv 


>  0  and 


1-In  DEA  literature  the  values  of  these  variable 
are  referred  to  as  slack  values  because  of  the  way  in 
which  Charnes,  Cooper  and  Rhodes  first  defined  the  DEA 
model  [19].  In  order  not  to  be  confusing,  these  vari¬ 
ables  will  be  referred  to  as  slack  variables  here,  but 
their  counterparts  in  the  second  stage  model  will  be 
called  surplus  variables  as  is  usually  the  case. 


represent  the  solution  vectors  of  multipliers  at  opti¬ 


mality  for  the  DEA  primal  problem  (3.1).  If  the  vectors 
$  =  V*  and  f  =  U£ ,  then  the  DEA  solution  requires  that 
for  all  s+m-1  elements  j  e  J* 

*Iy3  -  »Txj  -  ufYd  -  viT*j  -  (5-i 

i.e.,  the  basis  J*  defines  a  proper  facet.  The  converse 
follows  immediately  from  the  definition  of  a  proper 
facet.  Thus,  the  following  definitional  property  sum¬ 
marizes  this  connection  between  full  envelopment  and 
pr o pe r  facets. 

Property  1.  In  DEA,  an  inefficient  unit  k  is 
fully  enveloped  if  and  only  if  its  optimal  basis  defines 
a  proper  frontier  facet. 

This  somewhat  trivial  property  was  presented 
here  simply  to  make  the  point  that  in  DEA  the  existence 
of  a  proper  frontier  facet  for  unit  k  and  the  condition 
of  unit  k  being  fully  enveloped  are  synonomous .  Such 
clarification  will  be  of  benefit  later  when  the  new 
second  stage  evaluation  is  discussed  which  measures  the 


efficiency  of  not  lully  enveloped  units  relative  to  ex¬ 
tensions  of  nearby  proper  facets. 

Second  Stage  Method  for  Inefficient, 

Not -Fu lly -E nve loped  Units 

A  new  second  stage  method  is  presented  in  this 
section,  one  which  can  be  used  in  conjunction  with  DEA  i 
evaluating  the  range  of  inefficiency  in  not-fully- 
enveloped  units.  The  DEA  evaluation  is  performed  first, 
and  its  solution  effects  the  objective  function  and  the 
form  of  the  constraints  in  the  initial  iteration  of  the 
second  stage  evaluation.  Of  course,  if  a  unit  is  fully 
enveloped,  its  proper  facet  is  reflected  in  the  DEA  solu 
tion  and  no  second  stage  evaluation  is  required. 

Post-DSA  evaluation  of  not - f u lly- e nve lo pe d 
units  will  enable  the  determination  of  a  lower  bound  of 
efficiency  by  overcoming  the  pr obi sms  discussed  in 
Chapter  I  (pages  2"  -  35)  resulting  from  use  of  an  arbi¬ 
trarily  small  value  to  estimate  the  infinitesimal  e  whic 
heretofore  caused  slack  values  to  have  negligible  impact 
on  efficiency  measures  resulting  in  serious  overestima¬ 
tions  of  efficiency,  particularly  when  significant 
amounts  of  slack  were  present.  In  fact,  the  DEA  ef¬ 
ficiency  can  be  thought  of  as  an  upoer  bound  efficiency 


measure  since  by  definition  the  infinitesimal  e  values 
are  extreme  Ly  small  relative  to  the  magnitudes  of  input 
and  output  observations. 

In  contrast  to  DEA,  the  second  stage  evalua¬ 
tion  measures  the  efficiency  of  k  relative  to  nearest 
pr  o  pe  r  facet  and  its  extended  hyperplanes  thereby  provid¬ 
ing  a  measure  of  minimum  efficiency  which  is  sensitive  to 
the  amount  of  slack  present.  It  is  minimum  in  the  sense 
that  further  reduction  in  the  efficiency  measure  would 
require  a  change  in  basis  corresponding  to  selection  of 
a  more  distant  facet.  Each  of  these  characteristics  will 
be  clarified  in  the  discussions  that  follow. 

For  this  discussion  let  E^^  =  the  set  of  DEA 

k 

efficient  units  associated  with  the  basis  of  unit  k 

( X*  >  0)  and  let  E^~;  =  the  set  of  DEA  efficient  units 

not  associated  with  the  basis  of  unit  k  ( V*  =  0).  The 

3 

superscript  (1)  identifies  the  first  iteration  of  the 
second  stage  model.  The  complete  collection  of  DEA 
frontier  units  is  S  =  U  E^^.  This  reduced  set  S 

is  the  reference  set  for  all  of  the  second  stage  itera¬ 
tions.  the  first  of  which  is  shown  below. 


(3 


unrestricted;  y  ^  ,  s  f  k  >  3 


The  way  in  which  the  above  formulations  depend 
on  the  previous  DEA  optimal  solution  guarantees  that 
problems  (3.12)  and  (3.13)  have  feasible  solutions.  The 


solution  urk  =  u*k  for  r  =  l,2,...,s. 


ik 


-  v 


ik 


for 


i  =  1,2,  .  .  .  ,m  is  feasible  for  problem  (3.12)  where  u*  k  and 


are  optimal  values  from  DEA.  The  solution  X  : 


(1) 


0 


=  X 


for  j  c  y 


^1)  v f 1  j  =  X*  =  0  for  j  c  E,;-',  srk  =  y 


?(D  S(D  , 

k  ’  rk  ■'rk 


(1)  _ 


for  every  r,  s>k'  =  0  for  every  i  and  cok  =  0^  is  feasibl 
for  (3.13)  where  X *.  ,  j  =  l,2,...,n  and  @k  are  optimal 
values  from  the  DEA  dual  model  given  in  (3.2).  Thus, 
existence  of  feasible  solutions  for  both  the  primal  and 
dual  problems  guarantees  the  existence  of  a  finite  opti¬ 
mum  . 


Furthermore,  if  unit  k  is  inefficient  and  not 
fully  enveloped,  i.e.,  positive  slack  values  exist  in 
the  optimal  solution  to  DEA  dual  problem  (3.2),  then  the 
values  of  the  above  solution  which  were  derived  from  DEA 
primal  problem  (3.1)  and  dual  problem  (3.2)  can  be  sub¬ 
stituted  in  the  objective  functions  of  (3.12)  and  (3.13) 
to  yield  the  following  two  equalities: 


lk  ik 


Because  of  c om p le me nt ary  slackness,  if  s^£  >  0  or  s" 
for  some  r  and  i,  then  the  corresponding  primal  multi¬ 
pliers  equal  their  lower  bound,  i.e.,  u*^  =  v*  ^  =  6. 
Furthermore,  if  u*^.  >  0  or  v*x  >  0  for  some  p  and  q,  then 
their  associated  slack  values,  s^*  and  s“£,  equal  zero. 
Thus,  the  equality  at  (3.14)  can  be  rewritten  as: 


£>  U1 

hil}  =  L  urksrk  +  E  viksik  = 


Z  c.s-^ 


(3.16 


Since  the  objective  function  of  the  DEA  dual  problem 
(3.1)  and  primal  problem  (3.2)  are  equal  at  optimality 
and  since  h£  and  are  both  greater  than  zero: 


s 


(3.16)  and  (3.17),  one  ob- 


Combining  relations  (3.15), 
tains  : 


ai  -  h5  < 


(3.13: 


Thus,  the  solution  derived  from  the  DEA  values  for  inef¬ 
ficient  unit  k  which  is  not  fully  enveloped  is  not  opti¬ 
mal  for  the  first  iteration  of  the  second  stage  model 
because  the  objective  function  values  of  the  primal  and 
dual  model  are  not  equal,  i.e.,  h^1^  < 

To  achieve  optimality,  one  or  more  of  the  u's 
and  v's  associated  with  positive  or  sj£  in  the  ob¬ 

jective  function  must  enter  the  basis  at  a  positive 


amount.  Entrance  of  any  such  multiplier  would  drive  its 
associated  surplus  variable  (s£^  or  sik^  model 
(3.13)  from  the  basis  which  in  turn  would  require  one  of 


/  I  1  2 

the  "►'j  '  variables  to  enter  the  basis  and  replace  the 

leaving  surplus  variable,  except  when  entrance  of  a 

J 

is  not  feasible.  The  case  where  variables  will  not 

J 

enter  is  discussed  later. 


^All  Xj  associated  with  5^  ^  were  basic  in  DEA 

and  will  remain  so  in  every  iteration  of  the  second  stage 
model.  Thus,  y\^-)  variables  are  the  only  nonbasic  vari¬ 
ables  other  than  surplus  variables  which  could  enter. 


The  equality  constraints  associated  with  the 

set  in  problem  (3.12)  guarantee  that  the  new  optimal 

solution  will  contain  the  X..  variables  associated  with 

J 

the  units  in  the  original  DEA  neighborhood  plus  others 
that  entered  as  the  surplus  variables  were  replaced.  If 
all  surplus  variables  and  sj^  in  (3.13)  are  non- 

basic,  the  process  stops  and  the  proper  facet  has  been 

determined.  If  at  least  one  r(  1 )  enters  the  basis  and 

J 

if  at  least  one  of  the  surplus  variables  remain  basic 
then  another  iteration  is  required.  For  this  next  itera¬ 
tion,  let 


J(l)  =  (J  c  e£1} 


enters  basis 


in  it erat ion  (  1 ) } 
(3.14) 


and  let 


U 


(3.20) 


then  the  second  iteration  primal  model  becomes: 


z  ^k'yrj 

r  =1 


.k  xi; 


Z  u(§)  . 

^rk  ^rj 


z  vSk)ltiJ  <  0  for  J  c3<21 

i  =1 


^  vik ^xik 


( 2  )  (2) 

4rk  »  vik  ^  0 


As  shown  in  the  first  iteration,  a  feasible 

solution  can  be  constructed  for  iteration  (2)  from  the 

optimal  values  of  iteration  (l),  a  solution  which  falls 

short  of  optimality.  This  second  iteration  model  will 

attempt  to  drive  some  of  the  remaining  surplus  variables 

s^2)  or  sjj^  from  the  basis  of  the  dual  model  replacing 

them  with  variables.  The  iterative  process  continue 

«J 

until  an  iteration  (N )  is  reached  where  s+m-1  ^  and 

(N  )  (N  ) 

y i  '  variables  are  basic  or  where  no  y ■  can  enter  in 
J  J 

which  case  a  leaving  surplus  variable  s^jp  or  is 

replaced  by  another  surplus  variable  prohibiting  further 
progress  in  obtaining  a  full  basis  associated  with  s*m-l 


actual  units.  The  form  of  the  primal  and  dual  models  at 
iteration  (N )  are  shown  below  and  numbered  for  future 


re  fe  re  nee  . 


Primal 


Max  h(.N) 


_  |  (N)  (N-l)*  +  “  (N)  (N-l) 

-  -  ^  r  k  s  r  k  ^  v-;vS^v 

r  =1  i  =1 


s  .t  . 


Dual 


Mia  4K> 


s  .t 


rk  ark  '  ^  vik  &ik  <• 3  • 


(N), 


m 


E  ^rk'^rj  -  E  vik)xij  =  0  for  j  C  S^N) 
r  =1  i =1 


s 

I 

r  =1 


v  (N)  ”  (N)  ^  ^  .  -CN) 

E  ^rk  yr.1  '  E  vik  xi.i  1  0  for  j  c 


i  =1 


m 


E  v(N)x  -  1 
^  ;ik  xik  ~  1 
i  =1 


u(N)  V(N)  >  0 
4rk  *  vik  -  0 


(N). 


2  \\a'y  .  +  £  7  > 

cE(N)  3  ^  aCfCN)  J 


(N) 


=  s  (N-  l)" 


rk 


r  =  1,  2  ,  .  .  .  ,  s 


X.  „<!,(»)  -  Z 
ik  k 


X (N  )  x  .  .  -  L 


Vi 


(N) 


jCE(N)  J  J  jce(N) 
i  =  1, 2 ,  .  .  .  ,m 
x(N)  unrestricted:  7^).  s 


=  s(n-d* 
ik 


22) 


When  conditions  are  not  favorable  for  entry  of 


y  variables  into  the  basis,  a  proper  facet  cannot  be 
formed  because  one  of  the  u  or  v  multipliers  in  the  primal 


objective  function  would  need  to  assume  a  negative  value 


to  enable  another 


to  enter  the  basis.  A  negative 
multiplier  would  violate  the  characteristics  of  a  proper 
facet  which  require  negative  rates  of  substitution  and 
positive  marginal  productivities.  One  might  wish  to  con¬ 
tinue  the  iterations  allowing  negative  multipliers  to 
measure  the  lack  of  substitutability  of  variables  or  the 
syphoning  effect  that  a  poorly  used  resource  has  on  pro¬ 
duct  ion  . 


Other  properties  of  the  iterative  model  will  be 
described  in  the  next  section  to  illustrate  the  addi¬ 
tional  frontier  information  and  analytical  capabilities 
that  can  be  obtained  from  this  second  stage  process. 


Other  Properties 

The  primary  objective  of  this  section  is  to 
clarify  what  is  meant  by  the  concepts  '’minimum  efficiency 
or  "lower  bound  of  efficiency,"  concepts  which  were  in¬ 
troduced  in  previous  sections.  The  meaning  of  these 
terms  will  first  be  examined  geometrically.  Then  the 


mathematics  of  the  second  stage  evaluation  will  he  ex¬ 
plained  relative  to  this  geometric  interpretation. 

Minimum  Efficiency  Measure 
Explained  Ge omet r i ca lly 

Consider  the  single  output,  two  input  case 
shown  in  Figure  3.1.  In  this  figure  there  are  four  ac¬ 
tual  observations  (A,  B,  C,  and  K)  and  only  two  proper 
facets,  the  line  segments  A3  and  BC .  The  dotted  lines 
represent  all  possible  extended  facets,  real  and  artifi¬ 
cial,  for  the  not - fu  liy-e nve loped  inefficient  uni^  K, 
facets  which  could  be  used  to  provide  a  measure  of  ef¬ 
ficiency  for  unit  K. 

Clearly,  the  extended  facet  connecting  A  and  Mg 
would  provide  the  smallest  efficiency  measure  ( OT  )  *•  ( OK )  . 
But  A  is  the  farthest  frontier  point  from  K  and  Mg  is 
not  an  actual  observed  point  on  the  frontier.  The  seg¬ 
ment  CM^  provides  the  greatest  efficiency  measure 
(OP)  ♦  (OK),  but  it  also  contains  an  artificial  unit. 

This  measure  is  the  one  DEA  would  choose.  DEA  would  also 
assign  an  mount  of  slack  equal  to  CP,  and  C  would  be  the 
only  frontier  unit  represented  in  the  DEA  basis  for  unit 
K.  For  these  reasons,  when  the  unit  being  evaluated  is 
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not  fully  enveloped,  DEA  is  said  to  produce  an  u p per  bound 
efficiency  measure  and  an  artificial  frontier  facet. 

The  line  passing  through  A  and  C  is  not  a 
frontier  facet  and  therefore  does  not  provide  a  desir¬ 
able  reference  for  measuring  the  efficiency  of  unit  K. 

Of  the  remaining  two  lines,  the  extension  of  proper  facet 
BC  is  preferred  to  AB  because  BC  comes  closer  to  envelop¬ 
ing  K  and  it  contains  the  observation  C  which  is  the 
closest  of  all  frontier  points  to  K. 

The  efficiency  measure  ( 0Q,  )  t  (OK)  is  called 
the  "minimum  efficiency."  For  n ot - fu  1  ly-e nve lo ped  units, 
it  is  always  less  than  the  DEA  measure,  and  it  is  the 
smallest  efficiency  measure  achievable  without  changing 
to  a  reference  facet  farther  from  K.  Furthermore,  the 
"true"  relative  frontier  of  efficiency  lies  somewhere 
between  the  dotted  line  extending  BC  and  the  segment  CMj_ 
i f  unit  C  is  truly  efficient. 

The  measure  (0Q)  ♦  (OK)  is  most  desirable  be¬ 
cause  it  makes  use  of  information  from  actual  frontier 
units;  moreover,  the  rates  of  substitution  and  marginal 
productivities  in  the  neighborhood  of  extended  frontier 
point  Q  are  also  available  from  the  nearby  proper  facet 


BC  . 


One  tir.ai  observation,  is  necessary  to  comp  Let 
this  geometric  treatment.  Note  that  as  K  moves  closer 
full  envelopment  through  reduction  of  the  slack  amount 
CP,  the  measures  (OQ)  t  (OK)  and  (OP)  t  (OK)  move  close 
to  equality.  Thus,  the  difference  between  the  upper  an 
lower  bound s  of  efficiency,  as  defined  in  this  study, 
measures  the  degree  of  nonenvelopment.  For  fully  en¬ 
veloped  units,  the  upper  and  lower  bounds  are  equal  and 
the  DSA  optimal  solution  provides  an  appropriate  effi¬ 
ciency  measure. 

Mathematical  Expression  for  the 
Minimum  Efficiency  Measure 

The  mathematical  relationships  of  the  second 

stage  method  can  now  be  examined  in  light  of  the  above 

geometric  properties.  First,  consider  the  following 

optimal  dual  relations  for  the  rth  output  constraint  at 

each  of  N  iterations  (last  to  first): 

Itera¬ 
tion 


Dual  Constraints  at  Optimality 


)ual  Constraints  at  Optimality 


j  eE^N'  1') 


,  { N  -  1  w. 


rJ  ~  .  'J 

ipr(N-l) 


,  (3.24 


(  N- 1 ) *  _  _  (N-2  )* 


0 ( DE A  ) 


jil) 


*$l)**r,  * 


.  Z  xjyrj 
J  =1 


s(l)* 

^rk 


srk  ~  yr k 


Also  recall  that  at  any  iteration  M,  the  vectors  asso¬ 
ciated  with  j  c  E^-'*'^  in  the  previous  iteration  are 
forced  to  remain  in  the  basis  because  of  the  equality 
constraints  imposed  in  the  primal.  Thus, 


:fh4Ml  4N-1>?4N> 


3.25) 


which  guarantees  that  each  successive  iteration  contains 
the  original  members  of  the  DEA  basis  plus  those  added 
at  each  previous  iteration,  i.e.,  the  reference  set  for 
unit  k  is  not  allowed  to  change  to  a  basis  of  units 
(facet)  farther  from  k. 


Assuming  that  all  surplus  variables  are  zero 

at  the  Nth  iteration,  the  relations  at  (3.24)  can  be 

"telescoped,"  surplus  free,  by  first  replacing  the  sur 
(N- l)* 

plus  value  sr^  in  iteration  N-l  with  the  left  hand 

side  of  its  surplus  free  successor,  iteration  N,  and 
continuing  these  sue  ce  s  sor -t  o- pr  e  d  e  ce  s  s  or  substitution 
until  the  following  single  relation  is  obtained  in  the 
DEA  iteration: 


+  (-l)1  Z  x  j  ^  Jr*  + 

(-1)“  Z 


+  ( -l)1  z  y 1 yr  <  +  ... 

*  f  - 1  )N  z  yrj  =  yrk  r 

jce4» 


—  1,2,  ...,s 


Similarly,  the  iterative  optimal  relations  for  dual  in 


put  constraints  can  be  telescoped  to  obtain: 


I*.  ✓ 


(-1)2  I 

1ce(1) 


(3.27) 


.1  )N  +  1  2  V(N)*  .+ 

(  1)  '  1J 

Z  (-1)^4*)*  Xj  k  =  0 
t  =1 


?£xik 


i  =1,2, 


By  collecting  terms,  these  lengthy  equality  relations  can 
be  reduced  to: 


J  =1 


V  >.  f  & 

-  Z  X  .  x  .  . 


(3.28  ) 


a  ij 


-j  r  =  1,2, 

£  (-l)4^1*  *ik  .  0 

t  =1  J 


i  =  1,2, 


Where  terms  are  collected  as  follows: 


\(*  =  Z  (-l)tx(t  )*  +  Z  (-l)tq(^  )'* 


(3.29  ) 


tcL. 

J 


X '  =  0  if  unit  j  is  not  related  to  a  basic  dual 

J 

variable  in  any  iteration 


L.  =  ft|>)x'  is  basic],  t  =  0,1,  2,  ...,N 
J 


*  *  -  rW  <  "  . 


*-  -  * 
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(t  'i 

4  =  ft  v)  '  is  basic),  t  =  1,2,  ...,N 


(0)* 


=  X* 
J 


The  expression 


9£  - 


N 

E 

t  =1 


(-DWt  )* 

k 


(3.30) 


represents  the  "intensity"  of  the  reduction  of  unit  k's 

inputs  when  unit  k  is  compared  to  s+m-1  actual  efficient 

observations  from  the  nearest  complete  frontier  facet. 

The  above  equation  (3.30)  for  cd£  illustrates  how  the  DEA 

intensity  @k  is  reduced  by  the  iterative  second  stage 

process  of  bringing  nearby  efficient  observations  into 

the  basis  as  a  replacement  for  surplus  vectors.  This 

value  is  the  desired  minimum  efficiency  measure. 

Using  the  relations  at  (3.28)  and  the  optimal 

.  (N  )* 

primal  values  of  iteration  N  (u;k'  ,  r  =  1,2,...  ,  s  and 
v(N)*,  i  =  1,2, ...,m)  one  can  develop  an  alternate  ex¬ 
pression  for  oj*  which  provides  further  proof  that  it  is 

K 

the  minimum  efficiency  measure.  The  equations  at  (3.28) 
can  be  multiplied  by  the  appropriate  primal  value  to 
obtain : 


f-:*: 


■ '  .  ■  . 


Summing  all  of  these  equations,  one  obtains: 


n  s  /  \  m  /  \ 

r  L  -  r  v  »)*x. 

L  E  ^rk  yrj  h  vik  xij 

0=1  r=l  i  =1 


s  Cm  W  „  m  CN  )* 

=  2  4k  yrk  -  <  2  4k  xik 

r =1  i  =1 


(3.32 


The  part  of  equation  (3.32)  in  the  inner  brack 
ets  is  zero  for  every  unit  j  in  the  basis  at  iteration  N 
and  is  zero  for  every  unit  j  not  in  the  basis  at 

<J 

iteration  N.  Thus,  the  left  hand  side  of  (3.32)  is  zero 
Furt  he  rmore , 


*  -  1 

l  =1 


(3.33 


as  required  by  the  primal  linearizing  constraint.  Thus, 
equation  (3.32)  can  be  rewritten: 


Note,  the  primal  constraints  in  (3.22)  and  the 
equality  at  (3.34)  guarantee: 


s 

Z 

4(n)* 

Mrk 

<< 

C_i. 

1 

m 

Z 

v(N)*x.  .  =  o 

ik  xij  u 

j  c  e(N) 

(3 

r  =1 

i  =1 

s 

Z 

,(N)* 

4rk 

^rk 

m 

Z 

vik)*(“£xik) 

=  0 

r  =1 

i  =1 

s 

Z 

r  =1 

^rk 

(y  rkj 

WJ 

- 

Z  v(N)*x 
h  vik  xik 

i  =1 

-  0 

which  means  the  vectors 

would  be  rated  efficient  by  DSA,  i.e.,  both  are  frontier 
points  which  can  be  expressed  as  a  linear  combination  of 
nearby  facet  vectors. 


The  scaled  vector  of  inputs  cd^X^,  contains  the 
reduced  amounts  which  would  exist  at  an  extended  frontier 


point  having  the  same  proportionate  mix  of  inputs  and  the 
same  outputs  as  unit  k.  The  scaled  vector  of  outputs, 


_L .  Yv  contains  the  increased  amounts  which  would  exist 
at  an  extended  frontier  point  having  the  same  propor¬ 


tionate  mix  of  outputs  and  the  same  inputs  as  unit  k. 

The  essential  characteristics  of  the  minimum 
efficiency  measure  developed  above  can  be  restated  in  sum 
mary  fashion  as  follows. 


Property  2 .  If  the  second  stage  evaluation 
terminates  after  N  iterations  with  all  surplus  variables 
nonbasic,  then  the  minimum  efficiency  measure  is 


^  =  L  4k}^rk 

r  =1 


and  the  vectors 


(3.36  ) 


are  points  on  the  extended  frontier  and  can  be  used  as 
estimates  of  "values  if  efficient." 


Facet I nformat ion  from  Second 
Stage  Model 

Thus  far  in  this  section  the  focus  has  been  on 
the  minimum  efficiency  concept  and  little  has  been  said 
about  the  identification  of  additional  basis  units  and 
associated  multipliers  which  provide  valuable  information 
about  the  frontier  neighborhood.  The  facet  that  is  gen¬ 
erated  during  this  second  stage  process  can  be  defined 
as  the  set  of  all  possible  input/output  vectors  which 
can  be  expressed  as  convex  linear  combinations  of  observed 
input/output  vectors  in  the  optimal  basis. 

In  mathematical  terms,  the  reference  facet  for 

unit  k  is: 


Ft  =  f(Y,X ) | (Y,X  )T  =  £ 


i  > 


X.P.  and  L 

J  J  .  - (N  ) 

J  cl  £  ' 


M  =  i} 


where 


is  a  member  of  the 


set  of  observed  basis  vectors. 


If  the 


"values  if  efficient"  vectors  are  also  thought  to  repre¬ 
sent  feasible  production  possibilities,  then  these  vectors 
could  be  included  in  the  generation  of  convex  linear  com¬ 
binations  thereby  accepting  points  on  the  extended  fron¬ 
tier  as  production  possibilities. 

The  primal  constraints  of  the  model  for  vectors 
in  the  basis  guarantee  that  within  this  facet  the  rates 
of  substitution  and  the  marginal  productivities  are: 


Rates  of  Substitution: 


v<!>‘ 


v 


(N  )* 

pk 

(N  )* 

itp 

Pk 


q.  i  p 


<1/  p 


q>  P  c  (1,  2,  .  .  .  ,m} 


I,  P  e  (1,  2,  •  .  .  ,  s  } 


(3.33) 


Marginal  Productivities  : 


5yr 

3x7 

i. 


AV' 

3F 


i  =  1,  2,  .  .  .  ,  m;  r  =  l,2,...,s  (3.39) 


Note,  if  the  denominator  of  any  of  the  above  ratios  is 
zero,  then  the  ratio  is  not  defined  and  the  facet  is  not 
pr 0  pe  r  . 

The  second  stage  model  requires  that  each 


multiplier  be  >  0,  and  there  is  a  possibility  that  one 


or  more  of  the  multipliers  could  be  zero  at  the  final 
iteration,  which  implies  that  the  frontier  facet  is  as¬ 
sumed  to  be  parallel  to  each  of  the  input  or  output  axes 
associated  with  the  zero  multipliers.  For  example,  if 
v =  0  t hen 


dxq 

3xp 


0  for  every  a  such  that 


V(N  )* 
qk 


>  0 


(3.40  ' 


which  means  that  the  change  in  x^  along  the  facet  in  a 
direction  parallel  to  the  Xp  axis  is  assumed  to  be  zero 
for  every  input  q  having  a  positive  multiplier.  Of 
course,  the  ratio  is  not  defined  if  the  denominator  is 
zero. 


A  multiplier  for  input  p  would  be  assigned  a 
zero  value  by  the  model  if  the  rates  of  substitution  of 
that  input  with  others  in  the  facet  tended  to  be  non¬ 
negative  or  if  the  marginal  productivities  tended  to  be 
nonpositive,  conditions  which  would  occur  if  the  input 
p  did  not  trade  off  with  other  inputs  or  if  there  existed 
a  zero  or  negative  correlation  between  input  p  and  the 
outputs  (a  syphoning  effect). 


Pr  o  pe  rt  y  5  .  At  the  final  iteration  of  the 


second  stage  method,  the  appearance  of  zero  multipliers 


in  the  optimal  basis  indicates  that  the  facet  formed  from 
the  basis  vectors  is  not  proper  because  it  fails  to 
achieve  negative  rates  of  substitution  and  positive  mar¬ 
ginal  productivities. 

Test  Case 

Clark  [23]  performed  experiments  to  determine 
if  the  model  would  behave  as  expected  in  producing  the 
desired  frontier  information.  The  Educational  Productiv¬ 
ity  Council  1980-1981  data  base  provided  the  set  of  in¬ 
put  and  output  observations  used  in  the  experiments.  One 
inefficient  school,  Decision  Making  Unit  (DMU )  61,  was 
selected  for  evaluation,  and  all  103  efficient  schools 
were  used  in  the  frontier  reference  set. 

The  inefficient  DMU  61  (h  =  .341)  was  chosen 
for  the  following  reasons:  (l)  it  was  not  fully  en¬ 
veloped,  i.e.,  eight  of  the  thirteen  inputs  and  outputs 
had  positive  slack  amounts  in  the  DEA  optimal  solution 
which  caused  eight  multipliers  to  assume  the  lower  bound 
value  €  =  10“®;  and  (2),  only  four  efficient  schools 
were  identified  as  being  members  of  unit  6!  s  facet.  The 
results  of  the  DEA  evaluation  are  summarized  in  Table  3.1 
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Appendix  1  contains  the  details  of  the  optimal 
DBA  solution  for  DMU  61  and  the  identification  numbers 
for  frontier  reference  units  (constraint  numbers). 

The  second  stage  method  was  tried  using  the  E  PC 
data  set  and  then  compared  to  an  alternative  procedure 
for  generating  the  nearest  facet.  The  alternative  method 
involved  iterative  subtraction  of  slack  input  amounts 
from  the  observed  input  values  of  DMU  61  and  addition  of 
output  slack  to  the  output  observations,  a  process  which 
produces  adjusted  input  and  output  amounts  that  move  DMU 
61  closer  to  full  envelopment  at  each  iteration.  When 
DEA  is  retried  with  these  new  amounts,  conditions  become 
more  favorable  for  the  entry  into  the  basis  of  other 
variables  associated  with  nearby  frontier  observations. 
This  process  guarantees  that  the  units  identified  are 
members  of  the  nearest  DEA  facet.  Unfortunately,  17 
iterations  were  required  to  complete  the  evaluation  of 
DMU  61  using  the  alternate  method,  probably  a  result  of 
rounding  error,  and  only  six  additional  basis  units  could 
be  identified  for  a  total  of  ten  with  two  of  the  full 
set  of  s+m-1  not  identified. 

A  comparison  of  the  results  of  the  Charnes, 
Cooper  and  Rhodes  DEA  model  and  those  obtained  from  the 


alternate  and  second  stage  methods  is  given  in  Tables 
3.2  and  3.3. 

As  expected,  the  second  stage  evaluation  iden¬ 
tified  more  facet  units,  provided  more  multipliers  greater 
than  €  and  had  a  lower  efficiency  measure  than  either 
DEA  or  the  alternate  method.  Furthermore,  the  second 
stage  method  required  only  three  iterations  in  contrast 
to  the  17  required  by  the  alternate  technique. 

In  all  three  cases  the  multiplier  of  Input  5 
remained  at  its  lower  bound  of  e  and  the  second  stage 
evaluation  revealed  that  this  input  would  frustrate  any 
further  attempts  to  obtain  a  complete  basis  of  12  units. 

A  subsequent  analysis  revealed  that  Input  5  is  nega¬ 
tively  correlated  with  Output  3  within  the  facet  of  eleven 
units  formed  by  the  second  stage  method.  For  this  reason, 
its  multiplier  could  not  enter  the  basis  at  an  amount 
greater  than  e  without  first  driving  some  other  mul¬ 
tiplier  from  the  basis. 

At  this  point,  the  second  stage  process  works 
as  expected.  In  the  next  chapter,  this  technique  will 
be  used  again  in  assessing  the  relative  efficiency  of 
Air  Force  wings  and  in  describing  the  characteristics  of 
neighborhood  efficiency  frontiers. 


DEA 


A  Lternate 
Method 


Se  cond 
Stage 


Out  put 

1 

.oooooi(e) 

. 0003596 

Out  put 

2 

.010759 

.0104064 

Out  put 

3 

.000001(e) 

•000001(e) 

Input 

1 

. 003246 

. 0032422 

Input 

2 

.000001(e) 

. 0000952 

Input 

3 

.007437 

.0078976 

Input 

4 

.000001(e) 

.0001447 

Input 

5 

.000001(e) 

.000001(e) 

Input 

6 

. 006595 

.0055419 

Input 

7 

.000001(e) 

. 0003076 

I  n  put 

3 

.000001(6 ) 

.0010049 

Input 

9 

.000001(e) 

.0002436 

Input 

10 

.001064 

.0004477 

Sffioi 

ency 

.841 

.839 

.  0001303 
.  0096060 
.0006735 
.0031641 
.  001066 
.0074301 
.0002495 
.000001(6) 
.0054183 
.0003101 
.0011169 
.0002172 
.  0002862 
.811 


CHAPTER 


I  V 


USING  THE  DEA  MODEL  AND  EXTENSIONS 
IN  EVALUATING  AIR  FORCE  WINGS 


Introduction 

Air  force  tactical  fighter  wings  are  expected  to 
maintain  high  levels  of  combat  readiness  of  aircrews, 
fighter  aircraft  and  ground  support  resources.  The  Data 
Envelopment  Analysis  (DEA)  technique  with  extensions  de¬ 
veloped  in  this  study  appear  to  have  significant  potential 
for  use  by  the  Air  Force  in  monitoring  the  efficiency  of 
operations  and  planning  courses  of  action  which  will  remedy 
problems  and  increase  the  capability  of  combat  units. 

The  primary  purpose  of  this  chapter  is  to  pre¬ 
sent  a  small  numerical  example  which  provides  insight  into 
the  complexity  of  the  wing  evaluation  problem  and  which 
illustrates  the  use  of  DEA  and  the  extensions  developed  in 
Chapter  III.  The  input  and  output  measures  used  in  this 
chapter  are  similar  to  those  used  by  Air  Force  commanders 
and  resource  managers,  and  were  chosen  to  highlight  the 
hey  objectives,  operating  characteristics  and  input  factors 


of  wings.  Some  of  the  data  used  are  fictitious  but  it  is 


sy. 


hoped,  reasonable,  and  were  generated  for  purely  illustra¬ 
tive  purposes. 


Selection  of  Input  and  Output  Measures  and  Data  Used 


The  input  and  output  measures  used  in  this  anal¬ 
ysis  will  take  into  account,  either  directly  or  indirectly, 
the  following  resources  and  peacetime  initiatives  of 
wings: 


Available  Resources 


Personnel 


Aircraft 


Supplies 


Ground  Support 
Equipment 


Wing 

Peacetime 

Operations 


Peacetime  Initiatives 


Train  New  Pilots 

Maintain  Proficiency  of 
Experienced  Pilots 

Maintain  Readiness  of  Aircraft 

Maintain  Readiness  of  Ground 
Support  Equipment 

Train  Ground  Support  Personnel 

Maintain  Proficiency  of 
Experienced  Ground  Personnel 


Data  were  generated  for  fourteen  fictitious 
tactical  fighter  wings,  eight  of  which  (A  through  H)  are 
assumed  to  be  organized  under  one  intermediate  headquarters 
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and  the  remaining  six  (I  through  N)  under  another,  with 
both  intermediate  headquarters  reporting  to  the  Tactical 
Air  Command  Headquarters.  Wings  are  assumed  to  fall  into 
one  of  three  mission  categories:  combat  operations,  air¬ 
craft  familiarization  (training)  or  both.  Furthermore, 
each  wing  is  assumed  to  have  one  assigned  aircraft  type, 
and  these  different  types  can  be  further  classified  in 
terms  of  age  and  complexity.  These  classifications  are 
shown  in  Table  4.1. 

The  particular  input  and  output  measures  se¬ 
lected  for  use  in  this  example  are  defined  as  follows: 

Outputs  Selected 

Output  1:  Net  Comba t- Pr a c t i c e  Sorties  Flown . 

A  single  sortie  involves  the  departure,  flight  and  full 
stop  landing  (not  touch-and-go)  of  one  fighter  aircraft. 
When  the  aircraft  lands,  ground  operations  commence  to 
return  the  aircraft  to  mission  capable  status  and  prepare 
for  the  next  sortie.  Figure  4.1  shows  the  typical  activi¬ 
ties  occurring  during  sortie  generation  and  recovery  opera 
tions . 

The  number  of  sorties  flown  can  be  viewed  as  a 


surrogate  measure  of  wing  output  related  to  the  training 


Table  4.1 


Winq  Classifications 


Intermediate 
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Wings 
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Aircraft  Descriptions 

Age  Complexity 
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I 
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Very  complex  :  very  difficult  to  troubleshoot  and  fix 
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Refuel 
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Fly 
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Complete  Mission 

Reconfigure  tanks,  racks 
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Block  In 

Start  Aircraft 

Block  Out 

Figure  4.1 

Typical  Sortie  Cycle 

Activities 
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of  aircrews  and  the  exercising  of  ground  support  functions 
to  maintain  high  levels  of  personnel  readiness  and  to  keep 
mission  essential  equipment  in  good  operating  condition. 
Controllers  and  analysts  at  the  wing  monitor  the  mission 
departures  and  arrivals  of  aircraft,  and  they  keep  cumula¬ 
tive  sortie  records  by  day,  week,  month  and  year. 

One  category  of  sorties,  here  labeled  "net 
combat- practice , "  is  defined  as  those  sorties  flown  by 
fully  qualified  pilots  to  maintain  proficiency  in  combat 
tactics.  This  category  excludes  sorties  flown  in  training 
new  pilots  and  those  resulting  in  aborts,  e.g., 


Annual  Total  Sorties  Attempted  10,000 
Annual  Training  Sorties  -  2,500 
Annual  Air  Aborts  -  100 
Annual  Ground  Aborts  400 
Annual  Net  Comba t- Pr a c t i ce  Sorties  7,000 


The  data  used  in  computing  Output  1  for  each  of  the  14 
wings  ( A , 3 , C  ,  .  . .  , N)  in  this  example  are  shown  in  the  last 
column  of  Tat.e  4.2. 

Output  2:  Flight  Training  Sorties.  This  mea¬ 
sures  the  degree  to  which  a  wing  is  active  in  training 
pilots.  The  annual  requirements  for  training  sorties  are 
established  by  operations  and  tracked  by  analysis.  Annual 
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Table  4.2 

Net  Combat  Practice  Sorties 


1 

2 

3 

4 

5 

Wings 

Total 

Attempted 

(Annually) 

Ai  r 
Aborts 
(Annually) 

Ground 
Aborts 
(Annual ly) 

Training 

Sorties 

(Annually) 

Net  Combat 
Practice  Sorties 
(Annual ly)* 

A 

15,876 

240 

444 

0 

15,192 

B 

11,095 

300 

360 

0 

10 ,435 

C 

14,975 

384 

600 

0 

13,991 

D 

12,888 

240 

300 

0 

12,348 

E 

18,117 

384 

540 

17,193 

0 

F 

10,101 

120 

240 

9,741 

0 

G 

13,347 

288 

480 

9,148 

3,431 

H 

6,961 

96 

192 

0 

6,673 

I 

16,646 

312 

324 

0 

16,010 

J 

20,477 

240 

576 

19,661 

0 

K 

5,007 

125 

242 

4,640 

0 

L 

8,015 

168 

315 

5,021 

2,511 

M 

9,105 

96 

180 

6,147 

2,682 

N 

34,998 

720 

1020 

33,257 

0 

*Column  5 

=  (Column  1)  - 

(Column  2)  - 

(Column  3)  - 

(Column  4) 

,v  A  A  .*•  .*•  .*•  .  *■  .  ■ 


1  -y,a..V.  ■  .  A  *-. 


■t.  a  -a— i  ^t.' 
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training  sorties  for  each  of  the  hypothetical  wings  in 
this  example  are  shown  in  the  second  to  last  column  of 
Table  4.2 


Output  3:  Mission  Capable  Aircraft  Days .  An 
aircraft  can  be  Not  Mission  Capable  for  Supply  reasons 
only  (NMCS),  for  maintenance  reasons  only  (NMCM)  or  both 
(NMCB).  Thus,  let  there  be  j  =  1,2,. ..,n  aircraft.  The 
percent  of  time  that  the  j  th  aircraft  is  mission  capable 
during  the  year  is: 

$MC.  =  100  -  ($NMCM.  )  -  (?oNMCS,  )  -  (#NMCB  .  )  (4.1) 

3  t)  J  j 

Let  T.  be  the  total  number  of  days  the  j th  aircraft  is  on 
J 

hand  at  the  unit  and  let  T  =  £  T.  be  the  total  available 

3  J 

aircraft  days  at  the  unit.  Then  the  total  number  of  annual 
Mission  Capable  Aircraft  Days  (MCAD)  is: 

MCAD  =  £  MCAD-  =  £  T  .  [  foMC  .  ]  (4.2) 

j  J  0  3  1 

=  £  T  [  100  -  (^NMCM,  )  -  (fcNMCS,  )  -  (^NMCB  .  )  ] 

i  j  J  J  3 

Each  wing  or  squadron  is  expected  to  maximize  the  number 
of  mission  capable  aircraft  available  at  any  point  in  the 


time  to  remain  prepared  for  war.  Controllers  monitor  the 
mission  capable  status  of  aircraft  on  a  continuing  basis. 


The  data  used  in  computing  output  2  for  each  wing  in  this 
example  are  shown  in  Table  4.3. 


Inputs  Selected 


Input  1:  Average  Available  Aircraft .  The 
average  number  of  aircraft  on  hand  during  the  period  can 
be  computed  by  dividing  the  sum  of  not  mission  capable 
days  and  mission  capable  days  by  the  number  of  days  in 
the  period,  e.g.,  using  the  annual  data  in  Table  4.3  for 
wing  A: 


Not  Mission  Capable  Aircraft  Days  10,486  (column  2) 
Mission  Capable  Aircraft  Days  +  15,794  (column  3) 

Total  Aircraft  Days  26,280  (column  l) 

DaysinPeriod  _♦ _ 365 

Average  Daily  Aircraft  Available 


72 


Values  for  each  wing  are  shown  in  Table  4.4,  column  4 


Input  2:  Supply  Support  Factor.  Two  important 
considerations  in  assessing  supply  support  of  wing  flight 
operations  are:  (l)  Were  mission  essential  parts  avail¬ 
able  and  provided  upon  request?  (2)  If  mission  essential 
parts  are  not  available,  how  long  did  mechanics  have  to 


wait  for  these  parts?  The  fewer  parts  that  are  available 


Outputs 


Inputs 


1 

1 

2 

3 

4 

5 

6 

7 

Wings 

Net  Combat 
Practice 
Sorties 
(Annual ly ) 

Flight 

Training 

Sorties 

(Annually) 

Mission 

Capable 

Ai  rcraft 
Days 

(Annually) 

Dai  ly 
Average 
Avai 1  able 
Ai  rcraft 
i  (During 
the  Tear) 

Supply 

Support 

Factor 

(Annual 

Average) 

Available  Mission 
Labor  Essential 

Hours  Equipment 

(Annually)  Availabili 
(x  1000)  (Days  Durii 
the  Year) 

A 

15,192 

0* 

15,794 

72 

6.1 

1,980 

81,000 

B 

10,435 

0 

10,083 

45 

17.3 

1,408 

55,000 

C 

13,991 

0 

14,552 

69 

26 

1,936 

80,625 

0 

12,348 

0 

13,771 

51 

13 

1,496 

55,375 

E 

0 

17,193 

21,667 

84 

17.3 

2,508 

100,000 

F 

0 

9,741 

12,795 

52 

10.4 

1,320 

57,500 

G 

3,431 

9,148 

16,848 

64 

25.9 

1,302 

75,000 

H 

6,673 

0 

10,178 

33 

26 

924 

37,125 

I 

16,010 

0 

16,196 

72 

13 

1,980 

79,800 

J 

0 

19,661 

22,297 

98 

8 

2,640 

110,250 

K 

4,640 

4,562 

22 

103.7 

740 

26,750 

L 

2,511 

5,021 

10,817 

70 

25.9 

1,188 

83,400 

M 

2,682 

6,147 

13,012 

80 

6.9 

1,179 

90,000 

N 

0 

33,257 

29,760 

112 

34.5 

4,400 

126,000 

*DEA  will  not  allow  zero  amounts  in  inputs  or  outputs.  Thus,  relative  small 
values  between  one  and  10  were  substituted  for  zero  in  several  DEA  trials. 
The  same  results  were  obtained  in  each  trial  implying  that  any  amount  less 
than  ten  is  sufficiently  small  relative  to  the  observed  positive  sortie 
amounts  and  can  be  used  as  an  acceptable  approximation  of  zero. 


or  the  longer  one  has  to  wait,  the  lower  the  supply  sup¬ 
port.  One  might  therefore  construct  a  measure  as  follows 
Suppose  there  are  j  =  1,2, ...,n  mission  essen¬ 
tial  parts.  Let  D,.  =  the  demand  for  the  jth  mission  es- 

O 

sential  part  during  the  year  being  considered.  Let  R.  be 

<3 

the  average  length  of  time  from  request  to  receipt  of  the 
jth  part.  Then  the  weighted  (weighted  by  demand)  average 
number  of  hours  awaiting  delivery  of  a  single  mission 
essential  part  would  be: 

(£  DR)  4  (S  D  )  (4.3 

j  J  J  j  J 

This  measures  supply  nonsupport ;  thus,  the  measure  of 

supply  support  should  have  a  reciprocal  relation  to  this 

sum,  perhaps  (S  Dj/E  D.R  )  X  p  where  P  is  a  scalar  multi- 
j  J  J  J 

plier  to  enlarge  each  of  the  values  to  a  size  appropriate 
for  DEA.  Supply  support  factors  for  this  example  were 
arbitrarily  assigned  as  shown  in  Table  4.5. 

Input  3:  Available  Labor  Hours  (in  Thousands  o 
Hours ) .  This  measures  the  size  of  the  available  workforce 
which  generally  varies  proportionately  with  the  levels  of 
flying  and  ground  support  activities  at  each  wing.  See 
Table  4.4  for  the  values  used  in  the  example. 


Wings 


Supply 

Support 

Factor* 


Wings 

Average  Number  of  Hours 

Awaiting  Delivery  of  a  Single 
Mission  Essential  Part 
(Annual  Average) 

(h) 

Supply 

Support 

Factor* 

(4-  *  10°) 

A 

16.39 

6.1 

B 

5.78 

17.3 

C 

3.85 

26.0 

D 

7.69 

13.0 

E 

5.78 

17.3 

F 

9.62 

10.4 

G 

3,86 

25.9 

H 

3.85 

26.0 

I 

7.69 

13.0 

J 

12.50 

8.0 

K 

.96 

103.7 

L 

3.86 

25.9 

M 

14.49 

6.9 

N 

2.90 

34.5 

*  Signifies  the  assumed  reciprocal  relationship  between  time  awaiting 
delivery  of  parts  and  the  two  outputs,  sorties  flown  and  mission 
capable  aircraft  days. 


Input  4:  Mission  Essential  Equipment  Availabil¬ 
ity.  Ground  equipment  authorizations  are  determined  at 
management  levels  above  the  wing,  but  wing  level  managers 
have  some  control  over  the  proportion  of  assigned  equip¬ 
ment  which  is  serviceable  at  any  one  time.  Higher  levels 
of  availability  and  serviceability  of  wing  mission  essen¬ 
tial  equipment  should  provide  smoother  more  efficient  fly¬ 
ing  and  maintenance  operations  resulting  in  greater  output 
Levels  of  ground  equipment  authorizations  also  vary  pro¬ 
portionately  with  levels  of  flying  and  required  ground 
support  activities,  but  wings  seldom  have  equipment  levels 
equal  to  authorizations.  One  measure  might  be  Z  A.  where 

J  3 

A.  is  the  amount  of  time  in  days  that  the  j th  piece  of 

j 

mission  essential  equipment  is  assigned  to  the  wing.  This 
measure  does  not  reflect  the  difference  in  value  of  indi¬ 
vidual  equipment  types,  e.g.,  a  power  cart  used  in  start¬ 
ing  aircraft  might  be  more  valuable  to  the  operations  than 
a  tow  bar.  See  Table  4.4  for  the  arbitrarily  assigned 


values  used  in  this  example  to  represent  cumulative  days 
of  mission  essential  equipment  availability. 


Computations  and  Interpretations  Using  the  Charnes, 
Cooper  and  Rhodes  DEA  Model 

The  Charnes,  Cooper  and  Rhodes  DEA  relative  effi 
ciency  of  each  wing  was  computed  using  t*.e  data  in  Ta¬ 
ble  4.4  and  the  BDEAV5  code  developed  by  Elam  [26].  The 
BDEAV5  code  is  a  modified  version  of  DEA3  which  was  de¬ 
veloped  by  Ali,  Bessent,  Bessent  and  Kennington  [3]. 

Elam's  revision  provides  for  interactive  selection  of  in¬ 
puts,  outputs  and  reference  units  and  adds  the  capability 
to  list  the  units  defining  a  particular  local  frontier 
along  with  the  associated  values  for  \  variables  in  the 
optimal  basis. 

Results  from  this  trial  of  the  Charnes,  Cooper 
and  Rhodes  DEA  method  are  summarized  below  in  two  tables. 
Data  for  the  wings  classified  as  efficient  by  the  model 
are  presented  in  Table  4.6,  and  results  for  those  classi¬ 
fied  as  inefficient  are  shown  in  Table  4.7. 

In  Table  4,6,  the  units  classified  as  efficient 
by  the  model  are  listed  with  their  observed  values  and  the 
DEA  optimal  values  of  multipliers.  Any  efficient  unit, 
say  D,  serves  as  its  own  frontier  reference  point  in  the 
Charnes,  Cooper  and  Rhodes  DEA  evaluation;  i.e.,  its  lamb¬ 
da  value,  equals  one,  the  other  lambdas  have  a  value 


Multipliers  )  Observed  Values 


5 


6 


1 

Effi  cient 
Wings 


2 

Net  Combat 
Practi  ce 
Sorties 
(Annual ly ) 


3 

Training 
Sorties 
(Annual  ly ) 


Mission 
Capable 
Ai  rcraft 
Days 

(Annual ly) 


Dai  ly 
Average 
Available 
Ai  rcraft 
(During 
the  year) 


Supply 

Support 

Factor 

(Annual 

Average) 


Available 
Labor 
Hours 
(Annually) 
(x  1000) 


8 

Mission 
Essential 
Equipment 
Avail abil i ty 
(Days  During 
the  Year) 


A 

15,192.0 

1.0* 

15,794.0 

72.0 

6.1 

1,980.0 

81,000.0 

D 

12,348.0 

1.0* 

13,771.0 

51.0 

13.0 

1,496.0 

55,375.0 

E 

1.0* 

17,193.0 

21,667.0 

84.0 

17.3 

2,508.0 

100 ,000.0 

F 

1.0* 

9,741.0 

12,795.0 

52.0 

10.4 

1,320.0 

57,500.0 

G 

3,431.0 

9,148.0 

16,848.0 

64.0 

25.9 

1,302.0 

75,000.0 

H 

6,673.0 

1.0* 

10,178.0 

33.0 

26.0 

924.0 

37,125.0 

1 

16,010.0 

1.0* 

16,196.0 

72.0 

13.0 

1,980.0 

79,800.0 

J 

1.0* 

19,661.0 

22,297.0 

98.0 

8.0 

2,640.0 

110,250.0 

M 

2,682.0 

6,147.0 

13,012.0 

80.0 

6.9 

1,179.0 

90,000.0 

N 

1.0* 

33,257.0 

29,760.0 

112.0 

34.5 

4,400.0 

126,000.0 

A 

.000065 

.000055 

£ 

.011688 

.012375 

€ 

6 

D 

.000080 

e 

£ 

e 

e 

€ 

.000018 

E 

€ 

.000003 

.000044 

.009367 

.006394 

€ 

€ 

F 

€ 

.000007 

.000073 

6 

.013319 

.000038 

.000014 

G 

€ 

.000006 

.000056 

.011568 

.003503 

.000072 

€ 

H 

.000042 

€ 

.000071 

e 

€ 

€ 

.000027 

I 

.000061 

e 

6 

.000581 

.007517 

.000394 

£ 

J 

€ 

.000003 

.000042 

.005516 

.008462 

€ 

.000004 

M 

.000005 

e 

.000075 

.003768 

.019255 

.000404 

€ 

N 

e 

.000005 

.000028 

e 

£ 

€ 

.000008 

For  DEA  it  is  necessary  to  use  the  relatively  small  value  of  1.0  because  zero 
amounts  are  not  allowed. 


1.  Furthermore,  in 


of  zero  at  optimality  and  6^  =  = 

the  optimal  solution  of  the  DEA  dual  model,  all  slack 

values  sT*  and  s+,*  are  zero  when  the  unit  k  is  efficient. 
_k  rk 

As  a  result  of  these  conditions,  for  frontier  units  the 
Charnes,  Cooper  and  Rhodes  values  if  efficient  (y  ^  and 
$ik)  equal  the  observed  values,  i.e., 

yrk  =  yrk+  srk  =  yrk + 0  =  ^rk>  r=l,2,...,s  (4.4) 

*ik  =  0kxik“  sik  =  (Dxik-  0  =  xife,  i  =  1,2,...  ,m 

The  primary  areas  of  focus  for  the  discussion  in 
this  section  are  the  identification  of  efficient  wings, 
the  patterns  of  multipliers,  and  the  evaluation  of  ineffi¬ 
ciencies  using  the  Charnes,  Cooper  and  Rhodes  DEA  model. 
Inefficient  wings  are  evaluated  through  comparison  with 
frontier  facets  containing  one  or  more  of  the  efficient 
wings  in  Table  4.6.  How  this  is  done  will  be  described 
later  when  the  results  for  inefficient  wings  are  reviewed. 
There  are,  however,  some  interesting  observations  that 
can  be  made  regarding  the  and  v*^  multipliers  of 

efficient  wings . 

Note  first  that  nearly  one  half  of  the  multi¬ 
pliers  in  Table  4.6  are  e  values.  The  appearance  of  epsi¬ 
lons  in  the  optimal  DEA  solution  for  a  particular  wing 


implies  that  the  wing  achieved  the  maximum  efficiency  mea¬ 
sure  by  avoiding  actual  vectors  of  observations  which  if 
taken  into  account  would  reduce  the  efficiency  rating, 
i.e.,  an  optimal  dual  basis  was  formed  which  includes 
slack  variables.  At  optimality,  the  multipliers  provide 
the  highest  possible  efficiency  rating  for  the  wing  in 
question;  and,  if  no  alternative  optima  exist,  any  other 
feasible  assignment  of  multiplier  values  would  reduce  the 
efficiency  measure.  For  example,  if  additional  multipli¬ 
ers  of  wing  D  are  forced  to  exceed  their  lower  bound, 
slack  variables  would  leave  the  dual  basis  causing  \s  to 
enter  (provided  such  entry  is  feasible)  and  the  efficiency 
measure  would  decrease,  unless  of  course  alternative  op¬ 
tima  are  available. 

Each  of  the  wings  shown  in  Table  4.6  achieved 
its  efficient  rating  by  having  a  combination  of  slack  and 
lambda  variables  in  its  optimal  dual  basis.  Of  course, 

4*  —  * 

all  the  s  ^  and  s^  slack  values  for  each  wing  were  zero; 
otherwise,  the  wing  could  not  be  classified  as  efficient. 
If  an  optimal  dual  basis  of  an  efficient  wing  had  occurred 
with  no  slack  variables  in  it  (or  a  primal  with  no  e 
multiplie  , ) ,  then  a  proper  facet  would  have  been  known 
to  exist.  Unfortunately,  a  basis  free  of  slack  variables 


did  not  occur,  and  there  is  no  guarantee  that  a  proper 
facet  exists . 

Note  also  that  the  pattern  of  multipliers  with 
a  value  of  epsilon  in  the  first  two  columns  conforms 
closely  to  the  pattern  of  observed  output  values  which 
were  arbitrarily  assigned  a  relatively  small  value  of  1.0 
as  a  substitute  for  zero.  This  is  understandable  because 
the  Charnes,  Cooper  and  Rhodes  DEA  model,  in  maximizing 
the  efficiency  measure,  would  ordinarily  prefer  to  avoid 
assigning  relatively  large  multipliers  to  such  obviously 
small  output  amounts.  However,  since  the  model  considers 
all  observations  simultaneously,  one  cannot  always  predict 
which  observed  values  will  receive  an  epsilon  multiplier. 
All  input  and  output  observations  of  a  wing  are  assessed 
relative  to  the  observed  values  of  other  wings;  and,  as 
stated  previously,  the  combination  of  multipliers  assigned 
at  optimality  will  produce  the  highest  possible  efficiency 
rating. 

Note  that  the  wing  A  multiplier  for  training 
sorties  was  given  a  value  of  .000055  >  £  by  the  model  in 
spite  of  the  fact  that  the  relatively  small  value  1.0  was 
used  as  a  measure  of  the  output  called  training  sorties. 
Any  other  feasible  assignment  of  multipliers  for  wing  A 


would  produce  an  efficiency  rating  less  than  one  except 
when  alternative  optima  are  available. 

In  general,  multipliers  are  given  values  equal 
to  £  by  the  model  based  on  a  combination  of  factors  includ 
ing  the  relative  size  of  the  wing  and  its  performance  in 
producing  outputs  and  conserving  inputs.  Epsilon  multi¬ 
pliers  are  normally  given  to  outputs  which  are  too  small 
relative  to  the  observed  amounts  of  other  wings,  or  to 
inputs  which  are  too  large. 

The  input  and  output  observations  of  wings  in 
Table  4.6  form  a  frontier  of  relative  efficiency  which  is 
used  as  a  reference  in  evaluating  the  inefficiencies  of 
the  remaining  wings.  Each  of  the  wings  in  Table  4.7  re¬ 
ceived  a  Charnes,  Cooper  and  Rhodes  DEA  efficiency  rating 
less  than  one  (column  2)  when  compared  to  the  subset  of 
neighborhood  frontier  reference  units  shown  in  column  3. 

As  expected,  inefficient  combat  wings  were  compared  to 
facets  containing  similar  but  efficient  combat  wings;  the 
training  wing  K  was  compared  to  other  wings  with  training 
missions;  and  wing  L,  a  training  and  combat  wing,  was 
compared  to  an  appropriate  combination. 

In  every  case  in  Table  4.7,  the  subset  of  effi¬ 
ciency  frontier  reference  units  contained  less  than  the 


s+m-1  =  3+4-1  =  6  units  required  for  full  envelopment. 
This  lack  of  full  envelopment  is  directly  related  to  the 
presence  of  epsilon  as  optimal  values  for  multipliers 
(column  6)  and  the  positive  s*^  and  sT*  slack  amounts 
shown  in  column  7.  Thus,  the  Charnes,  Cooper  and  Rhodes 
DEA  efficiency  ratings  are  overestimated,  i.e.,  they  are 
upper  bound  measures  of  efficiency. 

According  to  Charnes,  Cooper  and  Rhodes,  each 
of  the  inefficient  wings  can  achieve  the  frontier  by  ad¬ 
justing  all  inputs  and  outputs  according  to  the  value  if 
efficient  formulae  (refer  to  Table  4.7) 

yrk  *  yrk  +  .  r»l,2,...,s  (4 

(column  9)  =  (column  5)  +  (column  8) 

and 

xik  =  =  hkxik  '  sik  5 

(column  9)  =  (column  7)  -  (column  8) 

In  other  words,  the  frontier  can  be  achieved  by  adding 

s*£  output  slack  amounts  to  observed  output  values  and 

—  * 

subtracting  s^  input  slack  amounts  from  intensity  ad¬ 
justed  inputs.  For  example,  the  values  if  efficient  for 
unit  C  in  Table  4.7  were  computed  as  follows: 


Observed  Outputs 


Output  Slack  Values  if  Efficient 


13,991.0  + 

0.0 

= 

13,991.0 

0.0  + 

0.0 

0.0 

14,552.0  + 

1,051.3 

= 

15,603.3 

(Observed  Inputs) 

x  Intensity 

Input  Slack 

69 . 0  (  .  8  7  ) 

2 . 6 

_ 

57 . 4 

26. 0( .87) 

8 . 0 

= 

14.6 

1 , 9  36 . 0 (  .87) 

0.0 

= 

1,684.3 

80 ,625 .0(  .87) 

7,847.7 

= 

62,296. 1 

The  values  if  efficient  were  similarly  computed  for  wings 
B,  K,  L,  and  all  results  have  been  included  in  Table  4.7. 

Furthermore,  the  vector  of  values  if  efficient 
for  any  wing  w  can  be  expressed  as  a  linear  combination  of 
wing  w's  efficiency  frontier  reference  units.  The  follow¬ 
ing  equality  relation  which  appears  in  the  dual  DEA  model 
illustrates  this  linear  relation: 


£ 

jc  B 


\*F  . 
„  0  J 


(4.6 


where  B*  is  the  set  of  efficiency  frontier  reference  units 


y  w  nrwy  \  urn  / 


Thus,  an  alternate  way  of  computing  the  value  if 
efficient  vector  for  unit  C  is: 


or  using  numerical  values  from  Tables  4.6  and  4.7 


12,348' 


13,990.3 


13,991.0+  0.0 


13,991.0 


13,771 


1.133 


1,496 
t 55, 375 , 


15,802. 5 


1,695.0 

62,740.0/ 


0.0+  0.0 


14,552.0  +  1,051.3 
(.87)69.0  -  2.6  = 

(.37)26.0-  8.0 

(.87)1,936.0-  0.0 

(.87)80,625.0  -  7,847. 7 , 


15,603.3 


1,684.3 

62,296.1 
V  / 


As  implied  by  the  appearance  of  epsilon  values 
for  multipliers  and  positive  slack  amounts  in  Table  4.7, 
and  as  suggested  by  the  values  if  efficient,  each  ineffi¬ 
cient  wing  should  be  able  to  achieve  the  same  or  greater 
outputs  with  fewer  inputs,  provided  such  reductions  in 
inputs  are  feasible.  It  is  unreasonable  and  unlikely  that 
wing  commanders  would  be  willing  to  reduce  the  input 
amounts  as  suggested  and  in  so  doing  give  up  the  extra 
capability  and  strength  these  valued  inputs  might  provide 
in  combat.  Instead,  emphasis  should  be  placed  on  making 
better  use  of  existing  resources  to  gain  higher  levels  of 
output.  With  the  aid  of  a  second  stage  evaluation,  ana¬ 
lysts  at  headquarters  and  managers  at  wing  level  could 
use  the  input  and  output  data  from  the  related  frontier 


units  identified  through  second  stage  assessment  and  the 


rates  of  substitution  determined,  from  multipliers  to  es¬ 
tablish  realistic  goals  for  improving  the  outputs  of  in¬ 
efficient  wings.  Headquarters  might  be  particularly- 
interested  in  using  neighborhood  frontier  observations 
as  a  reference  in  finding  alternate  resource  mixes  which 
might  enable  combat  wings  B  and  C  to  achieve  higher  lev¬ 
els  of  mission  capable  aircraft,  or  in  finding  a  mix  which 
might  enable  training  wing  K  to  increase  its  sortie  pro¬ 
duction  to  a  level  that  has  been  demonstrated  by  other 
wings. 

Furthermore,  input  and  output  "values  if  effi¬ 
cient"  might  become  more  useful  for  planning  purposes  if 
transformed  into  forms  commonly  used  by  analysts  and  man¬ 
agers  involved  in  the  Air  Force  planning  process.  Air 
Force  reports  and  plans  often  use  "rates"  instead  of  the 
total  output  quantities  used  in  this  analysis.  For  ex¬ 
ample,  one  might  transform  values  if  efficient  for  sorties 
and  mission  capable  days  into  the  following  rates  which 
are  commonly  used  in  the  Air  Force: 

1.  Sortie  Rate:  Annual  sorties  flown  by  the  wing, 
divided  by  the  average  number  of  aircraft  assigned  to  the 
wing,  divided  by  12  months,  to  yield  the  average  number  of 
sorties  flown  by  a  single  aircraft  in  one  month. 


Mission  Capable  Rate:  The  total  number  of  mission 


2  . 

capable  aircraft,  multiplied  by  100  and  divided  by  the 
total  number  of  available  aircraft  days. 

This  suggested  transformation  for  the  two  out¬ 
puts  of  wing  B  are  shown  below: 


Sortie  Rate  Flown  =  ~ _?  - 4  ?  ^  ■  =  19.3 

45  x  12 


Sortie  Rate  if  Efficient  =  — ■ -°'455  =  19.3 

45  x  12 


Mission  Capable  Rate 
Observed 

Mission  Capable  Rate 
if  Efficient 


=  10,083  x  100  _  61.4$ 
45  x  3G5 

—  11  ,6  3  0  X  100  _  y  q  Qdf 
45  X  365 


Comparison  of  the  above  observed  rates  and  the  correspond¬ 
ing  rates  if  efficient  imply  that  wing  B  should  continue 
its  19.3  sortie  rate  and  increase  its  mission  capable  rate 
from  61.4  percent  to  70.9  percent. 

Surely  there  are  other  transformations  and  other 
methods  of  data  analysis  which  could  be  used  to  take  ad¬ 
vantage  of  the  wealth  of  information  provided  by  the 
Charnes,  Cooper  and  Rhodes  DEA  model  and  to  exploit  its 
capabilities  in  assimilating  large  sets  of  observations 
for  evaluations  of  relative  efficiency.  This  model  is  a 
step  forward  in  organizing  and  assessing  multiple  factors 


simultaneously.  It  can  detect  inefficiencies  and  provide 
information  on  resource  averages  or  output  shortages, 
information  which  if  placed  in  the  hands  of  knowledgeable 
and  experienced  managers  could  very  well  lead  to  worth¬ 
while  inquiries,  explanations,  and  management  action. 

But  other  relevant  information  is  needed  to  com¬ 
plete  the  efficiency  evaluation  of  the  not- fully- enveloped 
wings  in  Table  4.7.  A  second  stage  evaluation  should  be 
performed  to  determine  the  lower  bound  or  minimum  effi¬ 
ciency  measure  and  to  determine  the  marginal  rates  of 
substitution  and  productivity  in  the  facets  nearest  to  the 
inefficient  wings. 

Results  of  the  Second  Stage  Evaluation 

The  second  stage  iterative  procedure  was  per¬ 
formed  for  inefficient  wings  B,  C,  K  and  L  to  generate 
additional  frontier  information  and  to  illustrate  the  use 
of  the  theoretical  developments  presented  in  Chapter  III. 
In  this  section,  the  results  of  the  second  stage  evalua¬ 
tion  have  been  presented  and  compared  to  the  DEA  findings 
reported  in  the  last  section.  Furthermore,  the  lower 
bound  of  efficiency  of  each  wing  (minimum  efficiency  u^) 
has  been  computed  and  compared  to  the  upper  bound 


efficiency  measure  provided  from  solution  of  the  Charnes, 
Cooper  and  Rhodes  DEA  model.  Finally,  the  marginal  rates 
of  substitution  and  marginal  rates  of  productivity  rela¬ 
tive  to  the  facets  derived  from  the  second  stage  method 
have  been  reviewed  and  contrasted  to  those  obtained  via 
the  Charnes,  Cooper  and  Rhodes  method. 

Tables  4.8,  4.9,  4.10,  4.11  and  4.12  contain  the 
results  of  the  second  stage  evaluation  and  have  been  re¬ 
ferred  to  throughout  this  discussion. 

An  Increase  in  the  Number  of  Empirical 
Observations  Defining  the  Facets 

Table  4.8  shows  the  u*^  and  v*k  multipliers  pro¬ 
duced  by  the  Charnes,  Cooper  and  Rhodes  DEA  trial  together 

ft 

with  the  and  multipliers  obtained  from  the  last 

rk.  ik 

iteration  of  the  second  stage  analysis.  Note,  there  are 
far  fewer  multiplier  values  at  the  €  lower  bound  in  the 
second  stage  results  of  Table  4.8.  This  indicates  thac 
at  the  last  iteration  of  the  second  stage  model  more  fron¬ 
tier  units  were  included  in  the  comparison  set  or  facet  of 
each  inefficient  wing,  which  also  means  that  more  variables 
associated  with  vectors  of  empirical  observations  were 


present  in  the  optimal  basis. 


•Charnes,  Cooper  and  Rhodes 


Table  4.9  indicates  the  additional  wing  observa¬ 
tions  identified  through  second  stage  iterations  included 
in  the  facets  along  with  the  associated  lambda  variables. 

The  encircled  values  indicate  the  variables  which  were 

J 

basic  in  the  optimal  solution  of  the  Charnes,  Cooper  and 
Rhodes  DEA  model.  For  example,  the  original  DEA  optimal 
dual  basis  of  wing  C  contained  only  one  nonslack  variable 
\^;  but  in  the  second  stage  solution,  the  optimal  basis  in 
eluded  new  lambdas  associated  with  observations  from  fron¬ 
tier  wings  A,  I,  J  and  G. 

Note  also  that  some  of  the  lambda  values  in 
Table  4.9  are  negative  which  indicates  the  lack  of  full 
envelopment  of  inefficient  wings  B,.  C,  K  and  L.  These 
negative  lambdas  correspond  to  the  empirical  observations 
added  which  replaced  surplus  vectors  thereby  minimizing 
the  number  of  s£^  or  sT^  variables  in  the  optimal  basis. 

Proper  Facet  Detected  for  Wing  K 

In  the  original  Charnes,  Cooper  and  Rhodes  DEA 
solution,  wing  K  was  evaluated  relative  to  observations 
from  wings  F,  G  and  N  in  its  reference  facet;  but  at  the 
conclusion  of  the  second  stage  evaluation  s+m-1  =  3+4-1  = 


6  lambdas  were  in  wing  K' s  optimal  basis.  Thus,  wing  K 


was  compared  to  a  proper  facet  in  this  second  stage  analy¬ 
sis  and  all  *  and  values  were  greater  than  € 

( see  Table  4.8). 


Range  between  Upper  and  Lower  Bounds  of 
Efficiency  Indicates  Degree  of  Nonenvelopment 


Wing  K  is  of  particular  interest  because  as  a 
result  of  adding  wings  D,  E  and  J  in  forming  wing  K' s 
proper  facet  the  efficiency  measure  decreased  from  .87  to 
the  lower  bound  amount  of  .28  as  shown  in  Table  4.10. 


Recall  that  the  range  between  the  upper  and  lower  bounds 
of  efficiency  corresponds  to  the  degree  of  nonenvelopment. 
Thus,  wing  K  is  an  "outlier"  unit  and  should  receive  spe¬ 
cial  attention  in  any  follow-up  analysis  by  management. 

To  compute  wing  K's  value  if  efficient  as  sug¬ 
gested  in  Property  2  of  Chapter  III,  the  lower  bound  effi¬ 


ciency  measure  of  .28  would  be  used  to  adjust  the  vector 
of  output  observations  by  1/.28  =  3.57  as  follows: 


Combat- Prac t i ce  Sorties 

Training  Sorties 

Mission  Capable  Aircraft  Days 

Available  Aircraft 

Supply  Support 

Labor  Hours  (x  1000) 

Available  Equipment 


3.57  (0.0) 

3.57(4,640.0) 
3.57(4,562.0) 
22.0 
103 . 7 
704.0 
26 ,750 . 0 


0.0 
16 ,56  4.8 
16 ,286 .34 
22.0 
103 . 7 
704.0 
25 ,750.0 


Chames,  Cooper  and  Rhodes 


The  above  adjusted  output  values  imply  the  following  rates 
if  efficient : 

Sortie  rate  if 
efficient 

Mission  capable  rate  _  IS , 286  ♦  3  x  100  _ 
if  efficient  36  5  x  22  ~  202,8'° 

Clearly,  these  rates  if  efficient  are  unattain¬ 
able.  It  is  highly  unlikely  that  aircraft  which  have  been 
flying  at  a  sortie  rate  of  17.5  could  sustain  a  sortie 
rate  of  62.75,  and  it  is  impossible  to  achieve  a  mission 
capable  rate  greater  than  100  percent.  Thus,  the  .28 
lower  bound  efficiency  measure  is  inappropriate  for  com¬ 
puting  values  if  efficient. 

However,  the  comparison  of  wing  K  with  frontier 
units  shown  in  Table  4.11  suggests  that  the  .87  upper 
bound  efficiency  value  provided  by  the  Charnes,  Cooper  and 
Rhodes  DEA  trial  is  likewise  inappropriate.  The  data  in 
Table  4.11  were  obtained  by  dividing  all  input  and  ouput 
observed  values  of  each  wing  in  the  table  by  that  wing's 
observed  value  of  daily  average  available  aircraft,  which 
in  effect  scales  the  wing  observations  to  facilitate  com¬ 
parison.  Such  scaling,  which  is  equivalent  to  multiplying 
primal  constraints  of  the  DEA  and  second  stage  models  by 


16  ,56  4.8 
12  x  22 


=  62.75 


i  V*  VT»  1 


a  constant,  does  not  change  the  optimal  values  of  the  u, 
v,  |j.,  or  v  multipliers  presented  earlier  in  this  chapter. 
The  data  relationships  in  Table  4.11  indicate  that  wing  K 
is  indeed  an  outlier,  and  that  the  upper  bound  of  .87  is 
an  overestimation  of  its  efficiency. 

The  wing  K  amounts  in  columns  3,  5,  6  and  7  are 
outliers  in  the  sense  that  they  are  extreme  or  nearly 
extreme  when  compared  to  the  ranges  of  values  for  frontier 
units.  The  wing  K  value  for  the  average  number  of  mission 
capable  aircraft  days  per  aircraft  (column  3)  is  lower 
than  all  the  other  values  associated  with  efficient  wings 
in  column  3.  The  supply  support  factor  per  aircraft  for 
wing  K  is  substantially  higher  than  any  of  the  other 
values  in  column  5.  Similarly,  the  amount  of  labor  hours 
per  aircraft  available  to  wing  K  during  the  year  was  the 
second  highest  amount  in  column  6;  and  wing  K's  avail¬ 
ability  of  mission  essential  equipment  per  aircraft  was 
the  highes  t  amount  in  column  7. 

In  short,  wing  K  performed  poorly  in  achieving 
a  mission  capable  rate  that  was  too  low  relative  to  fron¬ 
tier  units  while  its  input  amounts  for  equipment,  labor 
and  supplies  were  too  high.  Furthermore,  the  mix  of  in¬ 
puts  at  wing  K  is  quite  different  from  other  wings  because 


of  its  extremely  high  outlier  value  for  supply  support. 

The  Charnes,  Cooper  and  Rhodes  DEA  solution  assigned  * 
values  to  the  multipliers  associated  with  supply  support 
and  equipment  availability  (see  Table  4.7,  column  6)  which 
in  effect  ignores  these  relatively  high  outlier  values  in 
order  to  achieve  the  .87  upper  bound  efficiency  estimate. 
The  true  efficiency  of  wing  K  is  lower  than  .87,  but  one 
is  unable  to  determine  how  much  lower  at  this  point  in  the 
analysis;  but,  as  stated  earlier,  the  .28  lower  bound 
measure  is  too  low.  Thus,  it  is  impossible  to  determine 
the  degree  of  inefficiency  in  wing  K  by  either  method. 

Perhaps  after  closer  inspection  of  wing  K,  know¬ 
ledgeable  managers  could  subjectively  estimate  the  degree 
of  wing  K' s  inefficiency,  which  might  enable  the  develop¬ 
ment  of  a  "phantom"  frontier  unit  for  inclusion  in  the 
neighborhood  or  facet  of  wing  K.  This  artificial  unit 
could  be  given  the  same  mix  of  inputs  as  wing  K  or  a  dif¬ 
ferent  mix  if  equipment  and  supplies  need  to  be  trans¬ 
ferred.  The  inclusion  of  this  artificial,  phantom  fron¬ 
tier  unit  in  the  facet  of  wing  K  should  be  constructed  so 
that  it  produces  an  efficiency  measure  for  wing  K  which 
is  equal  to  the  subjective  estimate  provided  by  managers. 

In  summary,  a  large  difference  between  the  upper 
and  lower  bounds  of  efficiency  for  any  given  wing  implies 


that  a  closer  inspection  of  this  outlier  wing  is  needed 
before  conclusions  can  be  drawn  about  its  actual  degree 
of  inefficiency. 

On  the  other  hand,  for  some  no t- fully- envelo ped 
inefficient  wings  like  C  and  L,  the  difference  between 
the  upper  and  lower  bound  measures  is  relatively  small 
(see  Table  4.10),  i.e.,  these  wings  come  closer  to  achiev 
ing  full  envelopment  than  did  wing  K.  In  such  cases  of 
near  envelopment,  the  upper  and  lower  bound  measures  pro¬ 
vide  better  estimates  of  the  actual  degrees  of  ineffi¬ 
ciency. 

Marginal  Rates  of  Substitution 
and  Productivity 

Regardless  of  the  degree  of  nonenvelopment,  the 
marginal  rates  of  substitution  and  marginal  rates  of 
productivity  obtained  from  the  second  stage  process  pro¬ 
vide  information  about  the  frontier  that  is  valuable  even 
when  analyzing  outlier  units  like  K.  These  rates  are 
useful  and  informative  because  they  are  derived  from  the 
nearest  set  of  empirical  observations.  Table  4.12  pre¬ 
sents  marginal  rates  of  substitution  and  productivity 


for  the  facet  associated  with  wing  K 


of  Producttvlt 


number  shown  in  column  i  and  row  J  is  the  partial  derivative  of  the  column  variable  with  respect  to  the  row  variable 
, ,  the  number  in  column  1  row  2  is: 


The  negative  values  in  Table  4.12  are  the  mar¬ 
ginal  rates  of  substitution  and  the  positive  values  are 
the  marginal  rates  of  productivity.  For  example,  the 
value  -1.30822  in  column  1,  row  2  of  Table  4.12  indicates 
the  marginal  rate  of  substitution  between  combat- practice 
sorties  (y^)  and  training  sorties  ( yg  )  .  Thus,  if  unit  K 
is  operating  efficiently,  an  increase  of  ten  training 
sorties  would  require  a  decrease  of  approximately  10  x 
(1.30822)  -  13  comba t- pra c ti c e  sorties,  provided  all 
other  input  and  output  amounts  remain  constant. 

For  wings  B,  C  and  K,  the  marginal  rates  of 
substitution  of  comba t- practice  sorties  with  respect  to 
training  sorties  are  all  nearly  equal  to  one  in  their 
respective  facets;  i.e.,  using  the  multiplier  data  from 
Table  4.8: 

(4.8 

.  0000518 
.0000319 


.  C000I91 
.  0000146 
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Thus,  combat- practice  sorties  and  training  sorties  trade 
off  nearly  one  for  one  in  each  of  the  facets.  The  trade 
off  appears  to  be  realistic  since  the  sortie  values  used 
in  this  example  were  actual  amounts  flown  by  real  tactical 
fighter  wings.  The  amounts  used  were  obtained  from  an 
FY31  Tactical  Air  Command  report  [44], 

The  marginal  rates  of  substitution  obtained  via 
the  Charnes,  Cooper  and  Rhodes  DEA  model  are  not  realistic. 
In  Table  4.7,  wings  B  and  K  were  the  only  inefficient  wings 
having  nonepsilon  multipliers  for  both  comba t- pr a c t i c e 
sorties  and  training  sorties.  Using  these  multiplier 
values,  the  following  marginal  rates  of  substitution  were 
obtained: 
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.822 


Wing  K  Facet 
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.000173 

.000009 


19.22 


The  above  rates  are  significantly  different  from  those 
resulting  from  the  second  stage  evaluation.  The  wing  K 


rate  of  -19.22  seems  particularly  excessive.  If  all  other 
input  and  output  values  remain  constant  and  if  a  wing  is 
operating  at  peak  efficiency,  then  one  would  expect  that 
an  increase  of  ten  training  sorties  would  require  a  reduc¬ 
tion  of  about  ten  comb  a t- pr ac t i ce  sorties  since  training 
sorties  and  combat- practice  sorties  require  nearly  the 
same  amount  of  resources. 

Furthermore,  the  data  in  row  1,  columns  1,  2 
and  3  of  Table  4.12  provide  the  marginal  values  of  one 
additional  aircraft  ( Ax^_  =  1)  in  increasing  each  of  the 
outputs;  e.g.,  if  wing  K  gains  one  additional  aircraft, 
then  to  remain  on  the  frontier  the  wing  should  produce 
about  511  additional  combat- practice  sorties  during  the 
next  year,  provided  of  course  that  all  other  inputs  and 
outputs  remain  unchanged.  The  remaining  data  in  Table  4.12 
could  be  used  in  similar  fashion  to  evaluate  the  impact 
of  other  changes  in  input  or  output  amounts. 

In  the  next  chapter,  a  network  graph  will  be 
presented  which  illustrates  the  use  of  optimal  second 
stage  multipliers  in  preserving  frontier  marginal  rates 
of  substitution  and  productivity  in  an  allocation  problem. 


CHAPTER 


V 


CONCLUSIONS  OF  THE  STUDY  AND  DIRECTIONS 
FOR  FURTHER  RESEARCH 


Introduction 

The  public  expects  military  efficiency  from  the 
combat  forces  it  supports  with  tax  dollars.  For  several 
years,  the  United  States  Air  Force  and  the  other  military 
services  have  been  searching  for  integrative  models  of 
efficiency  and  capability,  models  which  will  aid  in  the 
detection  and  diagnosis  of  operational  problems  as  well 
as  assist  in  budgeting  and  other  forms  of  planning. 

Many  of  the  efficiency  related  modeling  forms 
reviewed  or  adopted  by  the  Air  Force  have  been  either  simu 
lation  models  designed  to  project  expected  levels  of  mili¬ 
tary  capability  given  specific  resource  mixes  or  mathe¬ 
matical  programming  approaches  to  predict  the  frontiers  of 
productive  potential  of  these  mixes.  The  latter  is  par¬ 
ticularly  difficult  since  the  data  from  which  such  projec- 
tions  must  be  made  is  historical  in  nature  and  contains 
observations  related  to  inefficient  as  well  as  efficient 

processes.  Observations  from  efficient  operations  must 
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be  detected  first  to  provide  a  basis  for  predictions  of 
productive  potential. 

Furthermore,  too  little  is  known  of  the  underly¬ 
ing  productive  processes  in  military  operations  and, 
therefore,  it  is  difficult  to  specify  mathematical  rela¬ 
tionships  which  represent  these  processes.  As  a  result, 
the  Air  Force  must  rely  on  relative  measures  of  performance 
derived  from  empirical  data,  and  preferably  these  measures 
of  performance  should  be  derived  without  making  a  priori 
assumptions  about  the  mathematical  forms  of  the  underlying 
production  functions. 

Summary  of  Study  Results 

Many  of  the  analytical  techniques  currently  used 
by  the  Air  Force,  such  as  ratio  analysis,  do  not  require 
such  a  priori  specification  of  functional  forms,  but  these 
techniques  are  equally  unattractive  for  other  important 
reasons.  For  example,  ratio  analysis  requires  the  use  of 
partial  measures  of  performance  which  are  unable  to  take 
into  account  interactions  and  trade  offs  over  the  full 
range  of  inputs  and  outputs  of  a  process  making  it  diffi¬ 
cult  to  compare  the  performance  of  units  using  the  process. 
Such  partial  measures  can  cause  units  to  be  incorrectly 
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classified  as  efficient  or  inefficient  by  focusing  on  one 
or  a  few  of  many  important  factors  and  overlooking  others 
which  are  relevant  in  establishing  neighborhoods  of  com¬ 
parison;  i.e.,  the  use  of  partial  measures  can  lead  to  in¬ 
correct  assessments  of  performance  as  a  result  of  inadver¬ 
tent  omission  of  relevant  observations. 

Regression  is  another  analytical  technique  which 
has  been  commonly  used  by  the  Air  Force  for  estimating 
relationships  between  the  inputs  and  outputs  of  a  produc¬ 
tion  process.  Regression  does  require  an  assumption  about 
the  mathematical  form  of  the  production  function  (e.g., 
linear,  multinomial,  log-linear,  etc.),  and  in  many  applica¬ 
tions  is  used  to  provide  estimates  of  average  relationships 
which  are  uninformative  for  frontier  estimation  purposes. 

At  present,  regression  techniques  are  largely 
inappropriate  for  estimating  the  frontiers  of  efficiency 
and  productivity  of  public  service  agencies.  However, 
given  that  frontier  units  can  be  detected  by  some  other 
method,  regression  might  be  useful  in  follow-on  investiga¬ 
tions  to  predict  relationships  based  on  efficient  observa¬ 
tions  only,  provided  of  course  the  sample  of  efficient 
observations  is  large  enough  to  make  the  regression  results 
meaningful.  By  using  only  the  efficient  observations, 


regression  equations  are  obtained  -which  come  closer  to 
accurately  representing  frontiers  and  which  have  no  non- 
random  inefficient  behavior  subsumed  in  the  residual  term. 

Because  of  the  aforementioned  limitations  of 
ratio  analysis  and  regression,  the  efficiency  measurement 
concepts  of  Farrell  [27]  and  the  subsequent  formulation 
of  the  Charnes,  Cooper  and  Rhodes  Data  Envelopment  Analysis 
( DEA)  model  [ 1 9 ]  provided  a  much  better  approach  for  evalu¬ 
ating  the  efficiency  of  multiinput,  multioutput  public 
service  organizations,  and  provided  a  basis  for  further 
development  into  other  areas  of  analysis  and  management 
planning.  In  fact,  the  Charnes,  Cooper  and  Rhodes  DEA 
model  served  as  the  basic  starting  point  for  this  study. 
Their  model  enables  the  unified  analysis  of  multiple  tech¬ 
nical,  economic  and  effectiveness  measures  in  contrast  to 
past  reliance  by  the  Air  Force  on  "partial  measures"  of 
productivity.  This  DEA  model  makes  no  assumptions  about 
industry-wide  production  functions,  but  uses  empirical 
observations  to  measure  efficiency  relative  to  local  fron¬ 
tiers.  No  claim  needs  to  be  made  for  demonstrated  causal¬ 
ity  between  inputs  and  outputs  since  unspecified  processes 
are  the  causal  agent  and  the  model  allows  for  an  unknown 
amount  of  inefficienty  to  exist. 
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Furthermore,  the  Charnes,  Cooper  and  Rhodes 
method  takes  all  outputs  and  inputs  into  account  simul¬ 
taneously  including  differences  in  input/output  mixes  and 
trade  offs  among  factors.  It  indicates  which  organizations 
are  on  the  efficiency  frontier,  establishes  a  piece-wise 
linear  approximation  of  the  frontier  surface  using  effi¬ 
cient  units,  and  assigns  an  efficiency  measure  based  on 
how  far  the  unit  is  from  a  frontier  point  directly  between 
the  unit  and  the  origin,  a  point  for  which  input  and  out¬ 
put  values  are  linear  combinations  of  the  observations 
from  an  efficient  set  of  "neighborhood"  organizations  both 
real  and  artificial.  Limited  evaluation  of  frontier 
points,  neighborhoods,  and  upper  bound  efficiency  measures 
for  individual  units  are  accessible  through  the  Charnes, 
Cooper  and  Rhodes  DEA  method. 

Unfortunately,  their  method  is  not  a  remedy  for 
all  efficiency  analysis  difficulties.  It  can  indicate 
which  units  are  efficient  and  which  are  not;  and,  if  the 
efficiency  measure  of  a  unit  is  obtained  from  a  full  neigh¬ 
borhood  set  of  s+m-1  observations  (i.e.,  fully  enveloped), 
where  s  is  the  number  of  outputs  and  m  is  the  number  of 
inputs,  then  the  DEA  rating  is  an  accurate  representation 
of  the  degree  of  inefficiency  in  the  unit.  But  in  all 


reported  demonstrations  or  implementations  in  multiple 
input  and  multiple  output  situations  known  to  the  author, 
the  condition  of  being  fully  enveloped  never  occurs. 

The  lack  of  full  envelopment  is  indicated  by 
the  Charnes,  Cooper  and  Rhodes  model  in  the  form  of  posi¬ 
tive  amounts  of  slack  or  surplus  at  optimality,  and  some¬ 
times  these  amounts  are  large  causing  significant  over¬ 
estimations  of  efficiency  and  misleading  information  about 
how  to  achieve  the  frontier.  The  positive  slack  or  sur¬ 
plus  amounts  and  the  associated  o ve r e s t imat ions  of  effi¬ 
ciency  are  accompanied  by  frontier  comparison  sets  (neigh¬ 
borhood  facets)  with  too  few  elements  and  by  rates  of  sub¬ 
stitution  and  production  among  inputs  and  outputs  in  these 
facets  which  are  not  derived  entirely  from  empirical  ob¬ 
servations,  conditions  which  often  lead  to  erroneous 
conclusions. 

This  study  was  undertaken  to  identify  the  closest 
complete  set  of  empirical  frontier  observations,  or  a 
maximum  number  of  observations  if  a  complete  set  is  not 
achievable.  These  frontier  observations  serve  as  a  basis 
for  determining  approximate  rates  of  substitution  and 
productivity  in  the  neighborhood  of  an  inefficient  unit 
and  provide  a  range  of  efficiency  for  the  unit.  Such 


empirically  based  information  about  the  nearest  frontier 
region  or  facet  is  needed  so  that  additional  models  can  be 
formulated  to  explore  alternative  mixes  or  levels  of  inputs 
or  outputs  in  this  region. 

In  Chapter  III,  a  second  stage  model  was  pre¬ 
sented  for  locating  as  many  frontier  units  as  possible 
defining  the  nearest  facet  thus  enabling  the  computation 
of  a  lower  bound  of  efficiency  for  no t- fully- enveloped 
units.  The  second  stage  model  also  provides  information 
about  rates  of  substitution  and  marginal  productivity 
among  inputs  and  outputs.  These  extensions  were  tested 
in  Chapter  IV  on  a  three  output,  four  input  Air  Force  wing 
evaluation  problem,  and  the  results  obtained  were  consis¬ 
tent  with  the  theoretical  expectations. 

The  second  stage  technique  identified  more 
neighborhood  frontier  units  than  the  Charnes,  Cooper  and 
Rhodes  DEA  model  for  every  inefficient  unit  in  the  Air 
Force  example;  and,  as  expected,  the  efficiency  measures 
for  these  units  decreased  as  the  frontier  facets  were 


extended 


Potential  for  Further  Research  into  Resource 
Allocation  and  Goal  Setting 


The  developments  in  this  study  provide  a  few 
additional  analytical  capabilities  suitable  for  use  by  the 
Air  Force  in  the  analysis  and  interpretation  of  efficiency 
and  the  preparation  of  management  plans.  As  stated  above, 
these  extensions  include  methods  for  post  DEA  efficiency 
analysis  to  detect  rates  of  substitution  and  marginal 
productivities  in  nearby  frontier  facets,  facets  which 
are  formed  from  as  many  empirically  observed  values  as 
possible.  Such  methods  are  needed  in  developing  resource 
allocation  models  and  in  establishing  realistic  output 
expectations  in  management  plans.  The  connection  between 
the  above  methods  and  the  problem  of  resource  allocation 
will  now  be  illustrated  through  the  use  of  network  repre¬ 
sentations  of  the  key  mathematical  relationships  in  fron¬ 
tier  facets. 


Resource  Allocation 


Recall  that  at  the  final  iteration  (N)  of  the 

( pj) 

second  stage  evaluation  all  frontier  units  in  E  '  associ- 

K 

ated  with  the  facet  of  an  inefficient  unit  k  satisfy  the 


following  equality  of  primal  model  (3.22) 


S  wrk  yrj  '  E  vik  xij  =  °»  for  everir  i  e  E]t  (5.1 

r=l  i  =  l 

(u)«  *  (n)*  * 

To  simplify  notation,  let  M-rk  =  and  h  v^* 

Using  the  generalized  network,  graphing  conventions  of 
Glover,  Hultz,  Klingman  and  Stutz  [30],  the  mathematical 
relationship  at  (5.1)  can  be  represented  by  the  network 
graph  in  Figure  5.1. 

This  figure  is  one  component  of  a  larger  reallo¬ 
cation  network,  where  the  total  network  includes  all  of 
the  subordinate  firms  (decision  making  units)  belonging 
to  a  conglomerate  which  is  subject  to  the  allocation  de¬ 
cisions  of  a  single  headquarters.  The  physical  inputs  of 
each  firm  or  subunit  could  then  be  thought  of  as  resources 
some  of  which  could  be  redistributed  among  the  firms  in 
an  attempt  to  improve  the  overall  productivity  of  the  con¬ 
glomerate.  Thus,  physical  inputs  (e.g.,  people,  supplies 
and  equipment)  might  flow  from  one  firm  to  another  as  a 
result  of  the  allocation  decisions  of  top  level  managers. 

Arc  paths  in  the  network  represent  the  possible 
transfers  of  commodities  or  assets.  These  transfers  would 
also  have  unit  costs  associated  with  them,  and  management 
would  probably  specify  upper  and  lower  bounds  on  the 
amounts  that  could  be  transferred  and  similar  limits  on 


the  amounts  required  to  be  on-hand  at  specific  locations. 
Furthermore,  the  flows  traversing  the  arcs  could  be  acted 
on  by  multipliers  which  transform  the  flows  into  other 
units  of  measure;  e.g.,  "number  of  laborers"  could  be 
transformed  into  "labor  hours." 

Figure  5.1  illustrates  how  the  concepts  of  arc 
paths,  flows,  costs  and  multipliers  can  be  used  to  model 
the  equality  relation  at  (5.1).  This  figure  also  demon¬ 
strates  how  necessary  parameters  are  supplied  by  the  sec¬ 
ond  stage  evaluation. 

The  flows  in  Figure  5.1  represent  alloca¬ 

tions  of  resources  to  unit  k  from  some  earlier  portion  of 
the  overall  network  and  the  yr^  .'lows  are  the  outputs 
resulting  from  efficient  use  of  the  allocated  amounts  x  . 
The  costs  are  assumed  to  be  zero  implying  that  any  costs 
associated  with  transfer  of  resources  from  one  unit  to 
another  have  somehow  been  considered  in  earlier  portions 
of  the  overall  model. 

The  bounds  limiting  the  input  and  output  amounts 
on  the  arcs  are  determined  from  the  range  of  each  input 
and  output  value  in  the  frontier  facet  of  unit  k  as 


follows : 


Output  Bounds : 

br*  -  "^(N)  Brk  =  "“*(„)  ) 

0  c  P  k  J  C  h  k 

r  =  1 , 2  ,  .  .  .  ,  s 


Input  Bounds : 
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0  c  E  k 

i  =  1 , 2  ,  .  .  .  ,  m 


i 


“"(N) 

c  k 
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Thus,  the  allocation  of  resources  x^  and.  the  output  values 
produced  yrk  are  restricted  to  the  following  ranges  deter¬ 
mined  from  the  frontier  facet: 


ik 

< 

xik 

< 

A.  .  , 
ik’ 

i  =  1 , 2 

rk 

< 

^rk 

< 

Brk5 

r  =  1,2 

Of  course,  other  bounds  could  be  substituted  if  these 

values  were  not  considered  to  be  feasible  for  unit  k. 

*  .  * 

The  multipliers  on  the  arcs,  v^k  and  l/urk> 
preserve  the  relationship  at  (5.1)  above  as  follows.  The 


total  flow  into  the  unit  k  node  is: 
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The  flow  on  a  single  output  arc  r  out  of  the  unit  k  node 
must  be  Upk^rk  or^er  that  the  flow 


yrk  ^(^rk} 

will  occur  after  the  multiplier, 
leaving  the  unit  k  node  is: 


Thus  the  total  flow 


s 

urkyrk‘ 

r=l 

Finally,  flow  conservation  at  the  unit  k  node  preserves 
the  mathematical  relation  at  (5.1)  above. 

The  network  graph  in  Figure  5.1  should  be  thought 
of  as  one  component  in  a  larger  resource  allocation  net¬ 
work  which  guarantees  that  the  vector  of  resource  alloca¬ 
tion  to  unit  k  (  x]_it  >  x2^  >  •  •  •  >  xmic)  and-  the  vector  of  planned 
outputs  (  yifcjJ^k’  '  *  ’  ’  ^sk^  f°rtn  an  efficient  combination 
within  the  neighborhood  facets  formed  by  those  frontier 
units. 

Goal  Setting 

Efficiency  is  not  the  only  criterion  of  interest 
in  an  allocation  problem  for  public  service  agencies. 
Effectiveness  goals  must  also  be  addressed.  Perhaps 


several  agencies,  including  some  of  the  frontier  units, 
have  been  producing  levels  of  output  which  are  considered 
to  be  too  low  by  managers.  Perhaps  goals  should  be  set 
in  an  attempt  to  increase  the  levels  of  achievement  of 
units.  Figure  5.2  shows  one  possible  approach  in  estab¬ 
lishing  an  output  goal  for  all  of  the  j  =  l,2,...,n  units 
in  the  industry.  This  figure  represents  an  objective  of 
having  the  average  of  output  1  of  the  j  =  1, 2,...,n  units 
equal  or  exceed  the  particular  average  output  amount  Gj_ 
desired  by  management.  The  values  y  •  .= ,  j  =  l,2,...,n  are 
the  amounts  of  output  1  of  each  unit  j.  The  curved  arc 
having  flow  s+  is  a  surplus  arc  and  the  arc  s”  is  a  slack 
arc.  One  or  the  other  of  these  flows  will  be  nonzero  when 
ever  the  average  of  the  output  amounts 


n 


n 


arriving  at  the  output  1  node  is  not  equal  to  G  .  If  the 
average  is  greater  than  G  ,  then  the  surplus  flow  s+  will 
be  greater  than  zero  with  no  penalty  (a  cost  of  zero). 

If  the  average  is  less  than  G^,  then  s"  will  be  greater 
than  zero  with  a  high  penalty.  Thus  the  model  would 


prefer  to  achieve  an  average  amount  of  output  1  greater 
than  the  goal  desired  by  management. 

The  author  has  been  unable  to  pursue  the  alloca¬ 
tion  and  goal  setting  problems  much  further  than  the  lim¬ 
ited  points  presented  here.  But  further  study  in  these 
areas  would  prove  to  be  very  beneficial  and  enlightening. 

A  complete  network  representation  of  the  allocation  prob¬ 
lem  is  needed  with  a  collection  of  goal  setting  formula¬ 
tions  (perhaps  nonnetwork)  which  address  a  variety  of 
possible  goals  affecting  output  levels,  or  output  mix  or 
bo  th . 

Concluding  Remarks 

The  Air  Force  unquestionably  needs  models  to 
assist  in  the  identification  of  inefficiencies  and  to  en¬ 
able  the  development  of  plans  to  bring  about  technological 
changes  or  resource  reallocations  which  improve  the  col¬ 
lective  efficiency  of  combat  units  ‘and  which  help  guaran¬ 
tee  the  achievement  of  acceptable  levels  of  military  pre¬ 
paredness.  The  Charnes,  Cooper  and  Rhodes  Data  Envelop¬ 
ment  Analysis  model  plus  the  second  stage  extensions  pre¬ 
sented  in  this  study  and  the  suggested  further  developments 
into  areas  of  resource  allocation  and  goal  setting  are  all 


worthwhile  directions  for  research,  the  outcomes  of  which 
would  be  of  considerable  value  to  the  Air  Force  and  other 
public  service  agencies.  It  is  hoped  that  these  research 
directions  will  lead  to  field  implementations  of  management 
systems  which  promote  greater  efficiency  throughout  the 
public  service  domain  and  in  so  doing  help  feed  more 
starving  children,  hire  more  willing  workers,  educate 
more  deserving  students  while  continuing  to  maintain  our 
nation's  military  strength  and  security. 
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76.76V8-42.18V9-88.15V10  .LE.O 

24.  85.lUl*82.38U2*81i8U3-60Vl-120V2-30V3-19.84V4-4.42V5-97.59V6-28.57V7- 
88.62V8-85.62V9-94.77V10  .LE.O 

25.  80.7U1*80.75U2*78.2U3-60V1-120V2-30V3-24.52V4-5.34V5-97.65V6-33.33V7- 
79.25V8-63.75V9-74.37V10  .LE.O 

26.  78U1*84«63U2*83«2U3-60V1-120V2-30V3-41.45V4 -3.77V 5-91.43V6-100V7- 
73.61 V8-28.4V9-80. 25V 10  .LE.O 

27.  79.2U1*80.75U2»80.4U3-60VI-120V2-30V3-24.42V4-3.46V5-95.52V6-33.33V7- 
79.81 V8-31.71V9-75V10  .LE.O 

28.  73.9UW7.13U2*71.8U3-60 V 1-9 0 V2-30V3-23. 1 6V4-4.33 V5-96. 1 V6-10 0V7- 
78.35V8-15.49V9-22.54V10  .LE.O 

29.  61.6U1*62.63U2*65.4U3-40V1-75V2-35V3-21.25V4-3.23VS-83.1V6-100V7- 
65.5V8-6.49V9-22.08V10  .LE.O 

30.  82.3Ul*9  0U2'*9  0.4U3-4  0Vl-6  0V2-30V3-12.7SV4-4. 41 V5-95. 54V6-1 00V  7- 
58.14V8-86.27V9-100V10  .LE.O 

31.  78 .6U1 *86U2-*84 .6U3-6  0V1-75V2-20V3-7.05V4-4. 02V5-96.99V6- 100  V7- 
90.34 V 8— 9 4.55V 9—1 00V1 0  .LE.O 

32.  83.3U1+89.88U2+91.2U3-3S*  OV 1-55 V2 -20 V 3-9 ,18V 4-6.4  3V5-97.87V6-84.03V7- 
79. 1 6 V8-88.46 V9-1 00 VI 0  .LE.O 

33.  86.7U1*90.88U2*90.6U3-40V1-60V2-60V3-12.48V4-4.14V5-95.8V6-94.34V7- 
81.63V8-82.68V9-1 OOV1 0  .LE.O 

34.  74.7U1*84.63U2*82.4U3-50V1-95V2-30V3-9.2V4-5.48V5-94.24V6-42.86VT- 
73.76V8-89.68V9— 100V10  .LE.O 

35.  73.3U1*74.25U2-*73.6U3-50V1-45V2-12V3-22.1 f 4-4. 76  V 5— 95 .33 V6- 10  0V7- 
5 7.94 V8-50 .7 7 V9-49.23 V10  .LE.O 

36.  82 .4U1*82.13U2*81.6U3-35V1-45V2-10V3-16.98V4-4.27V5-98.71V6-100V7- 
52.02V8-89.36V9-74.47V10  .LE.O 

37.  88.4U1*92.5U2*93.8U3-40V1 -90  V2-4  5V3-2 1 .92 V4- 3.87V5— 98.29 V6- 10  0V7- 
69. 02 V8 -62 .96 V9-74.0  7 VI 0  .LE.O 

38.  8  4.4UW9.25U2  +  79.6U3-40V1-90V2-4  5V3-22.7V4-3.49V5-97.4  3V6-10  0V7- 
86.04V8-35.78V9-62.39V10  .LE.O 

39.  7  8 .4U1 *84 ,75U2  *86  U3-4  0 VI -90  V2 -4  5 V3-23 .83V4-4.57V5-94.8V6-60  V7- 
63.42V8-20V9-48.18V10  .LE.O 

40.  84.5Ul-*84.63U2*81.8U3-30Vl-60V2-15V3-29.36V4-3.36V5-96.7  6V6-1  00V7- 
75.91V8-77.91V9-87.21 V10  .LE.O 

41.  8  3.6UI*81.13U2«-76.4U3-45V1-60V2-30V3-26.2V4-3.65V5-9  6.57V6-33.33V7- 
74.47V8-79.01 V9-75.31V10  .LE.O 

42.  64.1U1 ♦64,13U2*52.6U3— 4 5V 1-60 V2- 30V 3-26. 2 1V4 -3.37 V5- 92.86 V6-1 00V7- 
78.08V8-4.92V9-32.79V10  .LE.O 

43.  T0.6U1*58.36U2+56.6U3 -50  V1-55V2-25V3-22.08V4-4.71 V5-94.57V6-66.67V7- 
67.81 V8-.010V9-15.63V10  .LE.O 

44.  89.8U1+90  .38U2+91.2U3  -45 Vi -9QV 2  - 30V3 -55 .28V4-4.6 1 V5-96 .57V6-100 V7- 
80.41V8-48.21V9-94.64 V10  .LE.O 

45.  81 ,8U1.83.88U2*79.6U3-45Vl-90 V2 -2 0V3-62.65V4-3.5 7 V5- 96.57V6-50 V7- 
74.15V8-78.95V9-84.21V10  .LE.O 

46.  79.6U1*77.63U2*75.2U3-45V1-60V2-30V3-27.04V4-4.56V5-95.2V6-80V7- 
48.97V8-84.48V9-86.21 V10  .LE.O 

47.  69.6U1W5.5U2*7  7U3-45V1-4  5.V2-2  0V3-29.86V4-4.22V5-98.51V6-100V7- 
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90.73V8-3.28V9- 59. 02V10  .LE.O 

88.  4  7U1*58.38U2*42.6U3-45V1-90V2-20V3-19.61V4-3.65V5-9T.43V6-1  00V7- 

77.16V8-.010V9-29.09V10  .LE.O 

49.  89.1Ul*93.38U2*91U3-45Vl-69V2-30V3-29.59V4-3. 02V 5 -9S .29V6-100V7- 
61.47V8-96.88V9-98.44V10  .LE.O 

50.  67 .4U  1 *63»25U2*58«4U3-45V t- 1 0 V 2 -2 OV 3- 28 .9 5V4 -  3 .76 V5-9 4 .48V6 -1 00V7- 
36.02V8-30.77V9-23.08V10  .LE.O 

51.  65.9U1*67.75U2*58.8U3-45V1-45V2-30V3-2?.02V4-3.05V5-97.14V6-100V?- 
56.78V8-51.61V9-53.76V10  .LE.O 

52.  79U1*77.13U2*72.6U3-90V1-120 V 2-30 V3-2 8.25 V4-6.23V5-98.29 V6-50V7- 
65.73V8-.01V9-6.67V10  .LE.O 

53.  79.8U1 *73.3802*68.80 3 -45V 1-45 V2 -3 OV 3- 4 1 . 48V 4-4 .93 V5-86.6 7V6 -1 00 V7 - 
26.06V8-67.65V9-55.88V10  .LE.O 

54.  90.3U1*87.88U2*91.4U3-69VI-90 V2-90V3-87.7 7V4-7. 16 V5- 97. 38V6-1 00 V7- 
99.4V8-33.33V9 -4 7.44V10  .LE.O 

55.  88.1U1*91.63U2*94 .8U 3 -45  V  1-6  5  V2 -2 0 V  3- 15. 55V4 -3.84  V5-94  .  V6-1  00  V7- 
80.82V8-86.27V9-100V1 0  .LE.O 

56.  90.5U1*96.63U2*93.6U3-40V1-60V2-25V3-19.38V4-4.86V5-95.57V6-100V7- 
93.93V8-97.37V9-100VIO  .LE.O 

57.  83.2U1*95.15U2*92.8U3-50V1-70V2-20V3- 12. 68V4-4. 1V5-97.29 V6-10 0V7- 
92.83V8-91.84V9-100V10  .LE.O 

58.  89U1*95.25U2*93.2U3-55V1-65V2-20V3-15.47V4-4.02V5-91.77V6-100V7- 
91. 96V 8- 95.12 V9-1 00 V 1 0  .LE.O 

59.  92.3U1*91.13U2*91.4U3-40VI- 75 V2-20V3- 12.6TV4-3.7V5-99. 7V6-75V7- 
96.876V 8 -96.12V9-100V10  .LE.O 

60.  77.1U1*80.75U2*80U3-45V1-80V2-15V3-12.46V4-4.02V5-96.5V6-75V7- 
26.63 V8-70 .79 V9-1 0 QV 1 0  .LE.O 

61.  84.8Ul*90.75U2*9l . 4U3 -45 V 1-75V2-25V3- 13 .8 7V 4-4.23 V5-99 .29V6-75V 7- 
66.2V8-79.83V9-100V10  .LE.O 

62.  84.1Ul*90.38U2*84.6U3-40 Vl-70 V2 -25V3- 1 3.2 V4 -4.48V5-9 7.07 V6-75 V7- 
77.02V8-75V9-100V10  .LE.O 

63.  94.3Ul*96.75U2*95.2U3-45Vl-85V2-20V3-24.97V4-3.75 V5-97.71V6-1 00V7- 
86.49V8-95.31V9-100V1 0  .LE.O 

64.  88.5U1*95.75U2*95U3-45V1-70V2-30V3-12 .86V4-4  .27V5-87 .36V6-1 00 VT- 
93.6V8-89.01V9-100V10  .LE.O 

65.  78.3U1*86.5U2*84.0U3-50V1 -5 0 V2-25 V3-1 2 .91 V4-3.38 V5-98.8 6V6-10 0V7- 
67.07V8-87.5V9-100V10  .LE.O 

66.  91 .5Ul*95.38U2*93.2U3-40Vl-65V2-30V3-17.95V4-3.79V5-97.43V6-100V7- 
93.36V8-100V9-100V10  .LE.O 

67.  84.4U1*94.25U2*90 .4  U 3-50 VI -70V 2 -25V 3- 17 . 68 V 4-3 . 72V5 -97V6-50 V 7- 

987.91 V8-90.2V9-100V10  .LE.O 

91 .1U1*92U2*87.2U3-55V1-65V2-20V3-15.27V4-3.5V5-84.29V6-100V7- 
79.02V8-96.43V9-100V10  .LE.O 

69.  91 .6UI*96.63U2*97U3-40V1-70V2-25V3-14.82V4-3.43V5-98.29V6-100V7- 

91.41 V8-96V9-100V10  .LE.O 

70.  89.4Ul*93.0U2*90.6U3-45Vl-70V2-20V3-i6.7V4-4.UV5-98.19V6-66.67V7- 

94.93V8-97.14V9-100V10  .LE.O 

71.  8  7 .2U1 *9  3 .5U2*90. 6U3-50 VI -6  5V2-25V3-1 5.99 V4-4. 08 V5-9  7. 14 V6-10  0V7- 

67.83V8-84.04V9-100V10  .LE.O 

72.  9 4.4 U1 *9602*96.4 U3 -40V 1-6 5V 2-25 V3- 13.5 7 V4-4.3V5-98. 21 V6- 100 V7- 

84.94V8-85.06V9-100V10  .LE.O 

73.  91 .801*95.75U2*94U3-40V1-YOV2-20V3-14.97V4-4.2V5-97.89V6-100V7- 

93.7V8-85.59V9-100V10  .LE.O 

74.  88.5U1*93.25U2*92U3-45V1-60V2-45V3-20.57V4-3.98V5-97.54V6-80V7- 

85.79V8-8  7.4 V 9— 90 .55 V 1 0  .LE.O 

75.  75.5U1 *83 .5U2 *79 . 8U3 -55 VI -5 5 V2- 1 5 V3-28 .2R V4-4 .86 V5-9 7 .6 6 V6-93 .4 6 V 7- 

69.93V8-60.7i V9-66.67V10  .LE.O 
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76.  85.9U1 «93.U2  *91.8113-4  5  VI -45V2-25V3-27.09V4-3.85V5-98.57V6-94.89V7- 
R7.87VR-93.02V9-95.35V10  .LE.O 

77.  73 .4U1 *82.6U2*80U3-40 VI -40V 2- 20 V3-26. 9V4-4. 07 VS- 9 9.1 3V6-R1. 74 V7- 
72.2RV8-73 • 26V9- 79 . 0  7  VI 0  .LE.O 

78.  92.2U1*87.13U2*86.6U3-60V1-120V2-20V3-37.31V4-5.08V5-9T.79V6-R5.B4V7 
49.86V8-72.73V9-97.73 V10.LE .0 

79.  96.7U1 *96.25U2*96.4U3-45Vl-90 V2-20V3-31.36V4-4.02 V5-99.38V6-R5.71 V7- 
78.75V8-82.72V9-96.3V10.LE.O 

80.  8lUl*81.38U2*75.6U3-40Vl-60 V2-30 V3-3R.33V4-5.45V5-96.08V6-68.65V7- 
22. 12V8-67.11V9-81.58V10  .LE.O 

81  .  92U1*93.75U2*90.8U3-60V1-90V2-15V3-40 .17V4-4.52V5-99 .51V6-100V7- 

82.55V8-95.83V9-97.92 V1Q  .LE.O 

82.  63.7U1*74.38U2*71U3-60V1-100V2-20V3-42.25V4-4.09V5-93.39V6-49.12VT- 
36.38V8-44.22V9-65.99V10  .LE.O 

83.  95.9U1*94.75U2*95U3-45V1-100 V 2-2 0 V3- 37. 0 3 V4-4 .64 V 5-9 7.5 4 V6- 10 0 V 7- 
85.19V8-88.06V9-95.52V10  .LE.O 

84.  B7.9Ul*93.38U2*94.2U3-50Vi-90V2-20V3-34.7&V4-3.04V5-91.16V6-32.38VT- 
72.62V8-91.76V9-96.47V10  .LE.O 

85.  94U1*90.63U2*91.4U3-45V1-90V2-1 5 V 3- 33 . 33 V4-4 . 14 V5 -95 .42 V6-98. 72V7- 
85.4V8-94.74V9-10QV10  .LE  .0 

86.  89U1*88.25U2*87.8U3-45V1-100V2-20V3-42.33V4-4.45V5-97.61 V6-40.91 V7- 
5  0 .2  3 V8-85. 09V9-96 .49 VI 0  .LE.O 

87.  86  «3U 1 *90.63U2  *8RU3-4  5V1 -90 V  2-20 V  3-36 .26V4-4.58V5-94 .61 V6-8 5. 71 V 7  - 
59.43 V8-80.56V9-88.89V10  .LE.O 

88.  71.9U1*64.75U2*61.8U3-60V1-75V2-30V3-36.85V4-4.31 V5-97.4V6-33.33VT- 
2.3V8-47.17V9-55. 66V 1 0  .LE.O 

89.  80.9Ul*85.63U2*82.RU3-40Vl-6QV2-15V3-35.56V4-4. 3 V 5-9 5.79 V6- 72 .73  V 7- 
51.53V8-73.99V9-R5.37V10  .LE.O 

90.  8  3 ,9U 1 *83.25U2*83U 3-45V1-75V2-20V3-30.4V4-4.34V5— 96. 49V6  -1 00V7- 
37.95V8-77.92V9-90.9I V10  .LE.O 

91.  76.8U1*84.5U2*76.8U3-45VI-100V2-20V3-34.74V4-4.17V5-92.67V6-100V7  - 
45.15V8-86.87V9-77.78V10  .LE.O 

92.  78.9U1*75.1U2*73.4U3-55V1-55V2-30V3-45.62V4-4.44V5-?6.78V6-90.91 V7- 
34.18V8-53.1V9-66.37V10  .LE.O 

93.  90U1*90.25U2*87.6U3-60V1-105V2-15V3-38.58V4-5.83V5-95.41V6-71 .4  3  V  7- 
68.79V8-83.5V9-96.12V10  .LE.O 

94.  71.7U1*74.5U2*74.6U3-55V1-130V2-21V3-15.81V4-4.64V5-96.95V6-100V7- 
79.87V8-3.51V9-10.53V10  .LE.O 

95.  85 .9U l *92 .13U2*94.6U3-50V 1-90 V2 -20V 3- 15.55V 4-3.82 V5-99.05V6 -66.67 V7- 
75.82V8-87.84V9-82.43V10  .LE.O 

96.  84Ul*86.63U2*89U3-50Vl-50 V2 -  3 QV 3  - 15.9 9V4-4 .25V5-9 3.0 3V6-80 V 7- 
70.22V8-8Q.91V9-74.55VIO  .LE.O 

97.  69.3U1*71.5U2*72.6U3-55V1-55V2-30V3-13.31V4-3.96V5-96.9V6-100V7- 

©83.01V8-27.38V9-30.95VI0  .LE.O 

87.8Ul*B6.l3U2*97.6U3-30Vl-l 20V 2- 20V3 -14 .54 V4-3. 6 3V5-98 .86V6- 83. 33V7 
63.72V8-40V9-26.67V10  .LE.O 

99.  75.5UI ♦8i.5U2*90U3-45Vl-50V2 -  30 V  3-1 3. 62V4-4. 79V5- 97. 86V6 -75 V7 - 

85.63V8-44.16V9-53.25V10  .LE.O 

1 00.  72.3U1*74«5U2*71.6U3-50V1-90V2-20V3-1 7.85 V4- 4.68 V 5-9 6. 38 V6- 1 0 0 V 7- 

79.71V8-1.64V9-22.95V10  .LE.O 

101.  74.1Ul*74.88U2*75.aU3-60Vl-90V2-40V3-ll.29V4-4.35V5-96.14V6-100V7- 

63.04V8-21.5l V9-4 9. 46V10  .LE.O 

102.  6 4 .4U1 .67 .1 3U2  *68 .4U3-60  Vl-SO V2 -4 5V3-22.51 V4 -3.49 V5  -94.29V6-100VT- 

100V8-57.14V9-23.38V10  .LE.O 

1  03.  7  4U1  *78.5U2*74.6U3-60 VI -6 3V2 -45 V 3-25 . 6V4- 3. 5 1 V5- 95.8 6 V6- 1 00 V7- 

98.25VR-66.67V9-47.62V10  .LE.O 

104  .  50V1*90V2*20V3*21.91V4*5.’IV5*90  .5 7V6 ♦ 1 00 V7 * 1 0 0V8 *92 .8 6 V9* 
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_85.71  V1Q.EQ.1 
Ul.GE. .000001 
U2.GE .. 000001 
U3.GE. .000001 
VI. GE.. 000001 
V2.GE.. 000001 
V3.GE. .000001 
V4.GE. .000001 
VS. GE. .000001 
V6.GE ..000001 
V7.GE. .000001 
V8.GE.. 000001 
V9.GE  ..000001 
V10.GE*. 000001 
RNGRHS 
OPTIMIZE 
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•  PROBLEM  NUMBER  1  » 


USING  REGULAR 

FIND  BASIS  FOR  UNIT  61 


SUMMARY  3C  RESULTS 


VAR 

VAR 

ROW 

STATUS 

ACTIVITY  OPPORTUNITY 

NO 

NAME 

NO 

LEVEL 

COST 

1 

U1 

-- 

S 

.0000010 

-- 

2 

U2 

— 

B 

.  01  0  7586 

— 

3 

U3 

-- 

B 

.0000010 

-- 

4 

VI 

-- 

3 

.00  32463 

— 

5 

V2 

— 

3 

.0000010 

— 

6 

V3 

— 

8 

.00  74373 

-- 

7 

V  4 

-• 

3 

.0000010 

-- 

8 

V  5 

— 

8 

.0000010 

— 

8 

V6 

— 

8 

.0065950 

— 

10 

V  7 

— 

B 

.0000010 

— 

11 

va 

— 

3 

.0000010 

— 

12 

V8 

— 

B 

.0000010 

— 

13 

V10 

— 

B 

.0010643 

— 

14 

—  SLACK 

105 

NB 

— 

5.454382% 

15 

—  SLACK 

106 

8 

.0107576 

— 

16 

—SLACK 

107 

NB 

— 

7  #26  75860 

17 

—  SLACK 

108 

8 

.00 32453 

-- 

18 

—  SLACK 

1  08 

N8 

— 

8.1282583 

18 

—SLACK 

110 

8 

.0074363 

-- 

20 

—  SLACK 

111 

N8 

— 

4*3631 157 

21 

—  SLACK 

112 

N8 

— 

1*2509771 

22 

—SLACK 

113 

8 

.0065940 

-- 

23 

— SLACK 

1 14 

N8 

— 

•9662492 

24 

—  SLACK 

115 

NB 

— 

18.7373354 

25 

—  SLACK 

116 

NB 

— 

5*3922690 

26 

—  SLACK 

117 

B 

.0010633 

— 

27 

—  SLACK 

0-  1 

8 

.  1877954 

28 

—  SLACK 

0-  2 

8 

.0937129 

-- 

28 

—SLACK 

0-  3 

8 

.1586697 

— 

30 

—  SLACK 

0-  4 

8 

.2960127 

— 

31 

—SLACK 

a-  5 

8 

.2422727 

— 

32 

--SLACK 

0-  6 

8 

.1954495 

— 

33 

—  SLACK 

0-  7 

8 

.  1789784 

— 

34 

—  SLACK 

D-  9 

8 

.1982330 

— 

35 

—SLACK 

0-  8 

8 

.1919999 

-- 

36 

— SLACK 

0-  10 

8 

. 2322809 

— 

37 

—  SLACK 

1-  11 

B 

.5679378 

-- 

38 

— SLACK 

0-  12 

NB 

— 

*0082485 

38 

—  SLACK 

0-  13 

NB 

— 

.0767510 

40 

—  SLACK 

0-  14 

8 

.1343025 

— 

4  l 

—  SLACK 

D-  15 

8 

.0970580 

— 

42 

--SLACK 

0-  16 

3 

.166011  l 

-- 

43 

--SLACK 

0-  17 

8 

.1914567 

-- 

44 

—SLACK 

0-  18 

8 

.2775117 

-- 

45 

—  SLACK 

0-  19 

8 

.20  76322 

— 

46 

--SLACK 

0-  20 

3 

.00  72  585 

— 

! 


BOUND 

VALUE 

INF 

INF 

tNF 

INF 

INF 

INF 

INF 

INF 

INF 

INF 

INF 

INF 

INF 

INF 

INF 

INF 

INF 

INF 

INF 

INF 

INF 

INF 

INF 

INF 

INF 

INF 

INF 

INF 

INF 

INF 

INF 

INF 

INF 

INF 

INF 

INF 

INF 

INF 

INF 

INF 

INF 

INF 

INF 

INF 

INF 

INF 
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SUMMARY  OF  RESULTS 


VAR 

VAR 

ROW 

STATUS 

ACTIVITY 

OPPORTUNITY 

BOUND 

NC 

NAME 

NO 

LEVEL 

COST 

VALUE 

47 

— SLACK 

0-  21 

8 

.0348852 

— 

INF 

48 

—SLACK 

0-  22 

8 

.2787440 

— 

INF 

48 

— SLACK 

0-  23 

8 

.1616402 

— 

INF 

50 

—  SLACK 

0-  24 

8 

.2762484 

— 

INF 

51 

—SLACK 

0-  25 

B 

.2724576 

— 

INF 

52 

—  SLACK 

0-  26 

8 

.  1858888 

— 

INF 

53 

—  SLACK 

0-  27 

8 

.2580466 

— 

INF 

54 

—SLACK 

0-  28 

8 

.2460187 

— 

INF 

55 

—  SLACK 

0-  28 

8 

.  3210083 

— 

INF 

56 

—  SLACK 

0-  30 

8 

.1213573 

— 

INF 

57 

—SLACK 

0-  31 

B 

.1645667 

— 

INF 

58 

—  SLACK 

0-  32 

8 

.0474088 

INF 

58 

—  SLACK 

0-  33 

8 

.3367328 

— 

INF 

60 

—SLACK 

0-  34 

B 

.20  30  308 

— 

INF 

61 

—SLACK 

0-  35 

B 

.1338640 

— 

INF 

62 

—  SLACK 

0-  36 

B 

.0347783 

— 

INF 

63 

—SLACK 

0-  37 

B 

.1865767 

— 

INF 

64 

—  SLACK 

0-  38 

8 

.3210347 

— 

INF 

65 

—  SLACK 

0-  38 

B 

.2283174 

— 

INF 

66 

—SLACK 

0-  40 

B 

.0285734 

-- 

INF 

67 

—  SLACK 

0-  41 

B 

.2135017 

— 

INF 

68 

—  SLACK 

0-  42 

B 

.3267174 

— 

INF 

68 

— SLACK 

D-  43 

B 

.3607874 

— 

INF 

70 

— SLACK 

0-  44 

8 

.1348376 

— 

INF 

71 

—  SLACK 

0-  45 

8 

.1180856 

— 

INF 

72 

—  SLACK 

0-  46 

B 

.2537558 

— 

INF 

73 

—  SLACK 

0-  47 

8 

.1851668 

— 

INF 

74 

—  SLACK 

0-  48 

B 

.3404526 

— 

INF 

75 

—SLACK 

0-  48 

B 

.1045327 

— 

INF 

76 

—SLACK 

0-  50 

3 

.2621684 

-- 

INF 

77 

—  SLACK 

0-  51 

B 

.3383184 

— 

INF 

78 

—  SLACK 

0-  52 

8 

.308451 1 

— 

INF 

78 

—SLACK 

0-  53 

B 

.2108317 

— 

INF 

80 

—  SLACK 

0-  54 

B 

.6408315 

— 

INF 

81 

—  SLACK 

0-  55 

B 

.0355456 

— 

INF 

82 

—SLACK 

0-  56 

8 

.0130814 

-- 

INF 

83 

—  SLACK 

0-  57 

B 

.0356232 

— 

INF 

84 

—  SLACK 

0-  58 

B 

.01 43735 

— 

INF 

85 

—SLACK 

0-  58 

8 

.0622888 

-- 

INF 

86 

—  SLACK 

0-  60 

B 

.1318406 

— 

INF 

87 

— SLACK 

0-81 

B 

.1170536 

— 

INF 

88 

—SLACK 

0-  82 

8 

.0801698 

-- 

INF 

88 

—  SLACK 

0-  63 

B 

.0048432 

-- 

INF 

80 

—  SLACK 

0-  64 

B 

.0218170 

— 

INF 

81 

—SLACK 

0-  65 

S 

.1762042 

— 

INF 

82 

—  SLACK 

0-  66 

B 

.0759868 

-- 

INF 
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VAR 

VAR 

ROW 

STATUS 

ACTIVITY 

OPPORTUNITY 

B0UN3 

NO 

NAME 

NO 

LEVEL 

COST 

VALUE 

93 

— SLACK 

0- 

67 

B 

.0805342 

-- 

INF 

9  4 

—SLACK 

$9 

N0 

-- 

.6018865 

INF 

95 

—SLACK 

0- 

69 

8 

.0310154 

— 

INF 

96 

—  SLACK 

0- 

70 

B 

.0484272 

INF 

91 

—SLACK 

0- 

71 

B 

.0895409 

-- 

INF 

98 

—SLACK 

0- 

72 

B 

.0372407 

— 

INF 

99 

—  SLACK 

0- 

73 

B 

.0006540 

INF 

100 

— SLACK 

0- 

74 

B 

.2173040 

-- 

INF 

101 

— SLACK 

0- 

75 

B 

.1069407 

— 

INF 

102 

—SLACK 

0- 

76 

S 

.0831855 

INF 

103 

— SLACK 

D- 

77 

8 

.1213998 

INF 

104 

— SLACK 

0- 

78 

B 

.1552538 

-- 

INF 

105 

— SLACK 

0- 

79 

8 

.01 73918 

— 

INF 

106 

—  SLACK 

0- 

80 

8 

.1980103 

— 

INF 

107 

--SLACK 

0- 

81 

B 

.0594289 

— 

INF 

108 

—SLACK 

0- 

82 

8 

.2295767 

INF 

109 

—  SLACK 

0- 

83 

B 

.0206094 

— 

INF 

110 

—SLACK 

D- 

84 

B 

.0104938 

— 

INF 

111 

—SLACK 

0- 

85 

8 

.0185319 

— 

INF 

112 

—  SLACK 

0- 

86 

8 

.0919567 

— 

INF 

113 

—SLACK 

0- 

87 

8 

.0385137 

— 

INF 

114 

—SLACK 

0- 

88 

8 

.4229324 

INF 

115 

—  SLACK 

0- 

89 

8 

.0428767 

— 

INF 

116 

—SLACK 

0- 

90 

8 

.1324373 

— 

INF 

117 

— SLACK 

0- 

91 

8 

.0798809 

-- 

INF 

118 

—  SLACK 

0- 

92 

8 

.302.7241 

-- 

INF 

119 

—SLACK 

0- 

93 

B 

.0670942 

INF 

120 

—  SLACK 

0- 

94 

B 

.1839922 

INF 

121 

—  SLACK 

0- 

95 

a 

.0609909 

— 

INF 

122 

—SLACK 

0- 

96 

B 

.1464174 

— 

INF 

123 

—  SLACK 

0- 

97 

B 

.3045598 

-- 

INF 

124 

—  SLACK 

0- 

98 

N0 

— 

.1730669 

INF 

125 

—SLACK 

0- 

99 

8 

• 194551 T 

INF 

126 

—  SLACK 

0- 

100 

B 

.1697448 

-- 

INF 

127 

—  SLACK 

0- 

101 

B 

.3734874 

— 

INF 

128 

—  SLACK 

0- 

102 

B 

.4541865 

— 

INF 

129 

—SLACK 

0- 

103 

B 

.3679880 

— 

INF 

130 

— ARTIF 

0- 

104 

N8 

— 

.8407651 

INF 

131 

—ART  IF 

0- 

105 

NR 

— 

-5.4543824 

INF 

132 

—ARTIF 

0- 

106 

NR 

— 

0.0000000 

INF 

133 

—  ARTIF 

0- 

107 

NB 

— 

-7.2675860 

INF 

134 

--ARTIF 

0- 

108 

N8 

— 

0.0000000 

INF 

135 

—ARTIF 

0- 

109 

NB 

— 

-8.1282583 

INF 

136 

—  ARTIF 

0- 

110 

NB 

-- 

0.0000000 

INF 

137 

—  ARTIF 

0- 

111 

N8 

— 

-4.3631157 

INF 

138 

—ARTIF 

0- 

112 

N8 

— 

-1.2509771 

INF 

132 
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VAR  VAR 


SUMMARY  OF  RESULTS 
ROW  STATUS  ACTIVITY 


NC 

139 

NAME 
— ARTIF 

NO 

0-113 

NB 

LEVEL 

140 

— ARTIF 

0-114 

NB 

141 

—ARTIF 

0-115 

NB 

142 

—ARTIF 

0-116 

NB 

143 

—  ARTIF 

0-117 

NB 

MAXIMUM  VALUE  OF  THE  OBJECTIVE  FUNCTION 


OPPORTUNITY 

COST 

0.0000000 

-.9662492 

-18.7373354 

-5.3922690 

0.0000000 


BOUND 

VALUE 

INF 

INF 

INF 

INF 

INF 


.840714 


CALCULATION  TIME  WAS  1.3160  SECONDS  FOR  32  ITERATIONS. 
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key.  In  1977  he  began  a  tour  of  duty  at  the  Air  Force 
Logistics  Management  Center,  Gunter  Air  Force  Station, 
Alabama.  While  assigned  to  Gunter,  he  served  as  a  project 
team  member,  then  as  a  project  manager  and  finally  as  the 
Chief  of  the  Plans  and  Programs  Division  for  the  Center. 
After  completion  of  the  Gunter  tour-,  he  was  awarded  the 
Air  Force  Meritorious  Service  Medal,  Second  Oak  Leaf 
Cluster  in  recognition  of  his  achievements  in  establish¬ 
ing  a  comprehensive  project  management  system.  In  January 
of  1981,  he  entered  The  University  of  Texas  at  Austin  as 
a  full  time  student  under  the  sponsorship  of  the  Air 
Force  Institute  of  Technology. 

Permanent  Address:  Route  1,  Box  139 

Edinburg,  Texas  78539 


